arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.11604cs.RO
收藏

上下文生成默认策略用于有界理性智能体

Context-Generative Default Policy for Bounded Rational Agent

Luddy School of Informatics, Computing, and Engineering at Indiana University(印第安纳大学卢迪信息学、计算与工程学院)

Durgakant Pushp, Junhong Xu, Zheng Chen, Lantao Liu

AI总结:

提出上下文生成默认策略,利用扩散模型预测未观察环境,结合B样条轨迹优化,使有界理性智能体自适应调整决策,有效避开未知障碍,并在真实无人机实验中验证了适应性。

摘要:

有界理性智能体通常通过评估有限的选择集来做出决策,这些选择通常基于先前经验,从被称为“默认策略”的参考点衍生而来。然而,静态默认策略固有的刚性在智能体于未知环境中运行时带来了重大挑战,这些环境未包含在智能体的先验知识中。在本工作中,我们引入了一种上下文生成默认策略,该策略利用机器人观察到的区域来预测环境的未观察部分,从而使机器人能够基于实际观察到的地图和想象出的未观察地图自适应地调整其默认策略。此外,有界理性框架的自适应特性使机器人能够通过在默认策略附近选择性地采样少量轨迹来管理不可靠或不正确的想象。我们的方法利用扩散模型进行地图预测,并采用基于采样的规划与B样条轨迹优化来生成默认策略。广泛评估表明,上下文生成策略在识别和避开未见障碍物方面优于基线方法。此外,使用Crazyflie无人机进行的真实世界实验证明了我们提出的方法的适应性,即使在训练分布之外的领域环境中也能发挥作用。

英文摘要:

Bounded rational agents often make decisions by evaluating a finite selection of choices, typically derived from a reference point termed the $`$default policy,' based on previous experience. However, the inherent rigidity of the static default policy presents significant challenges for agents when operating in unknown environment, that are not included in agent's prior knowledge. In this work, we introduce a context-generative default policy that leverages the region observed by the robot to predict unobserved part of the environment, thereby enabling the robot to adaptively adjust its default policy based on both the actual observed map and the $\textit{imagined}$ unobserved map. Furthermore, the adaptive nature of the bounded rationality framework enables the robot to manage unreliable or incorrect imaginations by selectively sampling a few trajectories in the vicinity of the default policy. Our approach utilizes a diffusion model for map prediction and a sampling-based planning with B-spline trajectory optimization to generate the default policy. Extensive evaluations reveal that the context-generative policy outperforms the baseline methods in identifying and avoiding unseen obstacles. Additionally, real-world experiments conducted with the Crazyflie drones demonstrate the adaptability of our proposed method, even when acting in environments outside the domain of the training distribution.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑