arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2502.10568cs.AI
收藏

感知-aware 的概率规划在部分可观测性下

Observer-Aware Probabilistic Planning Under Partial Observability

Salomé Lepers, Vincent Thomas, Olivier Buffet

AI总结:

本文提出了一种基于观察-aware 马尔可夫决策过程的框架,用于处理部分可观测性下的规划问题,通过优化信息传输来提升可解释性和可预测性。

摘要:

在本文中,我们关注一类规划问题,其中智能体意识到观察者的存在,并且该观察者处于部分可观测状态。智能体必须选择其策略以优化通过观察传输的信息。基于观察-aware 马尔可夫决策过程(OAMDPs),我们提出一个框架来处理此类问题,从而形式化诸如可解释性、可解释性和可预测性等属性。将OAMDPs扩展到部分可观测性不仅可以处理更现实的问题,还允许考虑感兴趣的动态隐藏变量。这些动态目标变量允许例如处理可预测性或可解释性问题,其中目标可能在执行过程中发生变化。我们讨论了PO-OAMDPs的理论性质,并通过基准问题进行实验,分析HSV I在专用初始值下的收敛行为,并研究由此产生的策略。

英文摘要:

In this article, we are interested in planning problems where the agent is aware of the presence of an observer, and where this observer is in a partial observability situation. The agent has to choose its strategy so as to optimize the information transmitted by observations. Building on observer-aware Markov decision processes (OAMDPs), we propose a framework to handle this type of problems and thus formalize properties such as legibility, explicability and predictability. This extension of OAMDPs to partial observability can not only handle more realistic problems, but also permits considering dynamic hidden variables of interest. These dynamic target variables allow, for instance, working with predictability, or with legibility problems where the goal might change during execution. We discuss theoretical properties of PO-OAMDPs and, experimenting with benchmark problems, we analyze HSVI's convergence behavior with dedicated initializations and study the resulting strategies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑