在动态博弈中融合数据驱动先验
Blending Data-Driven Priors in Dynamic Games
AI总结:
本文提出KLGame算法,通过KL正则化将数据驱动参考策略与博弈论策略相融合,并引入可调参数在任务驱动与数据驱动行为间调节,实现实时求解多模态近似反馈纳什均衡,在自动驾驶场景中验证其能更有效地处理噪声理性人类行为。
摘要:
随着自动驾驶汽车等智能机器人在有人环境中日益普及,这些系统在安全、交互感知的运动规划中应在多大程度上依赖基于模型的博弈论规划器还是数据驱动策略,仍然是一个悬而未决的问题。现有的动态博弈公式假设所有智能体都是任务驱动的,并且行为最优。然而,在现实中,人类往往会偏离这些模型所规定的决策,其行为更适合在噪声理性范式下进行近似。在这项工作中,我们研究了一种将数据驱动参考策略与基于优化的博弈论策略相融合的原则性方法。我们提出了KLGame,这是一种求解非合作动态博弈的算法,该算法针对一个通用的、随机的、可能多模态的参考策略引入Kullback-Leibler(KL)正则化。我们的方法为每个决策者引入了一个可调参数,允许在任务驱动行为和数据驱动行为之间进行调节。我们提出了一种高效算法,用于实时计算KLGame的多模态近似反馈纳什均衡策略。通过一系列仿真和真实世界的自动驾驶场景,我们证明了与非正则化基线相比,KLGame策略能够更有效地融入参考策略的指导,并更好地考虑噪声理性的人类行为。包含更多信息、视频和代码的网站:https://kl-games.github.io/。
英文摘要:
As intelligent robots like autonomous vehicles become increasingly deployed in the presence of people, the extent to which these systems should leverage model-based game-theoretic planners versus data-driven policies for safe, interaction-aware motion planning remains an open question. Existing dynamic game formulations assume all agents are task-driven and behave optimally. However, in reality, humans tend to deviate from the decisions prescribed by these models, and their behavior is better approximated under a noisy-rational paradigm. In this work, we investigate a principled methodology to blend a data-driven reference policy with an optimization-based game-theoretic policy. We formulate KLGame, an algorithm for solving non-cooperative dynamic game with Kullback-Leibler (KL) regularization with respect to a general, stochastic, and possibly multi-modal reference policy. Our method incorporates, for each decision maker, a tunable parameter that permits modulation between task-driven and data-driven behaviors. We propose an efficient algorithm for computing multi-modal approximate feedback Nash equilibrium strategies of KLGame in real time. Through a series of simulated and real-world autonomous driving scenarios, we demonstrate that KLGame policies can more effectively incorporate guidance from the reference policy and account for noisily-rational human behaviors versus non-regularized baselines. Website with additional information, videos, and code: https://kl-games.github.io/.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。