arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2210.08672cs.ROcs.AIcs.MA
收藏

有限理性主体间的决策

Decision-Making Among Bounded Rational Agents

Indiana University(印第安纳大学);Expedia Group(亿客行集团)

Junhong Xu, Durgakant Pushp, Kai Yin, Lantao Liu

摘要:

当机器人与其他智能代理共享同一工作空间时(例如,其他机器人或人类),它们必须能够在完成指定任务的同时对其邻近代理的行为进行推理。在实践中,由于计算资源的有限性,智能体往往不会表现出绝对理性的行为。因此,预测最佳代理行为是不期望的(因为它需要禁止的计算资源)和不期望的(因为预测可能是错误的)。出于这一观察,我们删除了假设的完全理性的代理人,并建议将有限理性的概念从信息论的观点到博弈论的框架。这允许机器人推理其他代理的次优行为,并在其计算约束下相应地采取行动。具体地说,有限理性直接模拟了智能体的信息处理能力,表现为标称随机策略和最优随机策略之间的KL-分歧,而有界最优策略的解可以通过有效的重要性采样方法获得.在多机器人导航任务中使用模拟和真实世界的实验,我们证明了所得到的框架允许机器人对其他代理的不同层次的理性行为进行推理,并在其计算约束下计算出合理的策略。

英文摘要:

When robots share the same workspace with other intelligent agents (e.g., other robots or humans), they must be able to reason about the behaviors of their neighboring agents while accomplishing the designated tasks. In practice, frequently, agents do not exhibit absolutely rational behavior due to their limited computational resources. Thus, predicting the optimal agent behaviors is undesirable (because it demands prohibitive computational resources) and undesirable (because the prediction may be wrong). Motivated by this observation, we remove the assumption of perfectly rational agents and propose incorporating the concept of bounded rationality from an information-theoretic view into the game-theoretic framework. This allows the robots to reason other agents' sub-optimal behaviors and act accordingly under their computational constraints. Specifically, bounded rationality directly models the agent's information processing ability, which is represented as the KL-divergence between nominal and optimized stochastic policies, and the solution to the bounded-optimal policy can be obtained by an efficient importance sampling approach. Using both simulated and real-world experiments in multi-robot navigation tasks, we demonstrate that the resulting framework allows the robots to reason about different levels of rational behaviors of other agents and compute a reasonable strategy under its computational constraint.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑