通过影响增强的局部模型实现潜在的视角转换
Latent Perspective-Taking via a Schrödinger Bridge in Influence-Augmented Local Models
AI总结:
本文提出了一种基于影响增强的局部模型和施罗德桥的神经符号框架,用于实现机器人在社交交互中的心理状态推断和决策规划。
摘要:
在与人类共同操作的环境中,机器人需要在不确定性下做出决策。除了外源动态之外,它们还必须推断他人的隐藏心理模型和心理状态。尽管交互式POMDPs和贝叶斯理论of mind的公式化方法是原则性的,但精确的嵌套信念推断是不可行的,而手动指定的模型在开放世界设置中容易崩溃。我们通过学习结构化的心理模型和他人心理状态的估计器来解决这两个问题。基于影响基于抽象,我们实例化了一个影响增强的局部模型,将具有社会意识的机器人任务分解为局部动态、社会影响和外源因素。我们提出了(a)一个神经符号世界模型,实例化了一个因式分解的离散动态贝叶斯网络,以及(b)一个视角转换操作符,建模为一个在学习的局部动态上的近似施罗德桥,将因式分解的以自我为中心的信念转换为以他人为中心的信念。我们证明,这种架构使代理能够在基于模型的强化学习中合成具有社会意识的策略,通过决策时间的心理状态规划(信念空间中的施罗德桥),在MiniGrid社交导航任务中取得了初步结果。
英文摘要:
Operating in environments alongside humans requires robots to make decisions under uncertainty. In addition to exogenous dynamics, they must reason over others' hidden mental-models and mental-states. While Interactive POMDPs and Bayesian Theory of Mind formulations are principled, exact nested-belief inference is intractable, and hand-specified models are brittle in open-world settings. We address both by learning structured mental-models and an estimator of others' mental-states. Building on the Influence-Based Abstraction, we instantiate an Influence-Augmented Local Model to decompose socially-aware robot tasks into local dynamics, social influences, and exogenous factors. We propose (a) a neuro-symbolic world model instantiating a factored, discrete Dynamic Bayesian Network, and (b) a perspective-shift operator modeled as an amortized Schrödinger Bridge over the learned local dynamics that transports factored egocentric beliefs into other-centric beliefs. We show that this architecture enables agents to synthesize socially-aware policies in model-based reinforcement learning, via decision-time mental-state planning (a Schrödinger Bridge in belief space), with preliminary results in a MiniGrid social navigation task.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。