arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2110.15431cs.AIcs.LG
收藏

通用决策模型

Universal Decision Models

Adobe Research(Adobe研究院);University of Massachusetts, Amherst(马萨诸塞大学阿默斯特分校)

Sridhar Mahadevan

摘要:

人类是普遍的决策者:我们通过因果推理来理解世界;我们通过竞争来在商业、游戏和战争中获得优势;我们能够通过试错来学习做出更好的决策。在本文中,我们提出了通用决策模型(UDM),一个基于范畴理论的数学形式主义。UDM中的决策对象对应于决策任务的实例,从因果模型和动态系统(如马尔可夫决策过程和预测状态表示)到网络多人游戏和Witsenhausen的内在模型,它概括了所有这些先前的形式主义。UDM是一类对象,包括决策对象、观察对象和解决方案对象。互模拟态射映射在捕获结构保持抽象的决策对象之间。我们制定UDM的普遍属性,包括信息集成,决策可解性,和层次抽象。我们描述了UDM的通用函子表示,并提出了一个算法,用于计算UDM中的最小对象使用代数拓扑。我们勾勒出一个应用程序的UDM因果推理网络经济学,使用一个复杂的多层生产者-消费者双边市场。

英文摘要:

Humans are universal decision makers: we reason causally to understand the world; we act competitively to gain advantage in commerce, games, and war; and we are able to learn to make better decisions through trial and error. In this paper, we propose Universal Decision Model (UDM), a mathematical formalism based on category theory. Decision objects in a UDM correspond to instances of decision tasks, ranging from causal models and dynamical systems such as Markov decision processes and predictive state representations, to network multiplayer games and Witsenhausen's intrinsic models, which generalizes all these previous formalisms. A UDM is a category of objects, which include decision objects, observation objects, and solution objects. Bisimulation morphisms map between decision objects that capture structure-preserving abstractions. We formulate universal properties of UDMs, including information integration, decision solvability, and hierarchical abstraction. We describe universal functorial representations of UDMs, and propose an algorithm for computing the minimal object in a UDM using algebraic topology. We sketch out an application of UDMs to causal inference in network economics, using a complex multiplayer producer-consumer two-sided marketplace.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑