arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2604.25355cs.LO
收藏

从合取确定化到部分可观察性的信念构建

From Coalgebraic Determinization to Belief Construction for Partial Observability

Research Institute for Mathematical Sciences, Kyoto University(京都大学数学科学研究所);National Institute of Informatics, Tokyo(东京国立情报学研究所);The Graduate University for Advanced Studies (SOKENDAI), Tokyo(东京高级研究院)

Mayuko Kori, Kazuki Watanabe

AI总结:

本文提出了一种合取框架用于部分可观察系统的信念构建,通过将信念分解与Silva等人提出的合取确定化结合,展示了部分可观察系统的语义与相应信念合取的语义一致,并在特定条件下与完全可观察系统的语义一致,从而恢复了POMDP与信念MDP的标准等价性,并获得了加权转移系统与半模单子的新等价性结果。

摘要:

信念构建是一种将部分可观察系统转换为完全可观察系统的基本技术,同时保持相关语义。它在部分可观察系统分析中起核心作用,特别是部分可观察马尔可夫决策过程(POMDPs),这是人工智能和形式验证中的核心模型。在本文中,我们开发了一个合取框架用于信念构建。为了处理观察的范畴化,我们提升了一个单子到切片范畴,并引入了信念分解,按其观察重新组织状态。这使我们能够引入信念构建的合取泛化,通过将信念分解与Silva、Bonchi、Bonsangue和Rutten的合取确定化结合获得。在此框架中,我们展示部分可观察系统的语义与相应信念合取的语义一致。然后研究后者何时进一步与完全可观察对应物的语义一致,并利用此来确定部分可观察系统语义与相应完全可观察信念系统语义一致的条件。作为结果,我们恢复了POMDP与信念MDP的标准等价性,并获得了加权转移系统与半模单子的新等价性结果。

英文摘要:

The belief construction is a fundamental technique for transforming partially observable systems to fully observable ones while preserving the relevant semantics. It plays a central role in the analysis of partially observable systems, in particular partially observable Markov decision processes (POMDPs), which is a central model in artificial intelligence and formal verification. In this paper, we develop a coalgebraic framework for the belief construction. To handle observations categorically, we lift a monad to slice categories and introduce a belief decomposition that reorganizes states according to their observations. This allows us to introduce a coalgebraic generalization of the belief construction, obtained by combining the belief decomposition with the coalgebraic determinization of Silva, Bonchi, Bonsangue, and Rutten. In this framework, we show that the semantics of a partially observable system coincides with that of the corresponding belief coalgebra. We then study when the latter further agrees with the semantics of its fully observable counterpart, and use this to identify conditions under which the semantics of a partially observable system coincides with that of the corresponding fully observable belief system. As consequences, we recover the standard equivalence between POMDPs and belief MDPs, and obtain a new equivalence result for weighted transition systems with the semimodule monad.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑