arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2008.07081cs.LGcs.ROstat.ML
收藏

MIDAS:基于自适应策略的多智能体交互决策城市自主导航

MIDAS: Multi-agent Interaction-aware Decision-making with Adaptive Strategies for Urban Autonomous Navigation

Nuro, Inc.(Nuro公司);University of Pennsylvania(宾夕法尼亚大学)

Xiaoyi Chen, Pratik Chaudhari

摘要:

在拥挤、复杂的城市环境中进行自主导航需要与道路上的其他智能体进行交互。这个问题的一个常见解决方案是使用预测模型来猜测其他代理可能的未来行为。虽然这是合理的,但它会导致过于保守的计划,因为它没有明确地模拟交互代理的行为的相互影响。本文建立了一个强化学习为基础的方法命名为MIDAS自我代理学习影响其他汽车在城市驾驶场景中的控制动作。MIDAS使用注意力机制来处理任意数量的其他代理,并包括一个“驱动程序类型”参数来学习跨不同规划目标工作的单个策略。我们建立了一个模拟环境,使不同的互动实验与大量的代理和方法定量研究的安全性,效率和车辆之间的互动。MIDAS使用广泛的实验进行验证,我们表明,它(一)可以在不同的道路几何形状,(二)结果在一个自适应的自我政策,可以很容易地调整,以满足性能标准,如积极或谨慎的驾驶,(三)是强大的外部代理的驾驶政策的变化,(四)是更有效和更安全的比现有的方法,以交互感知决策。

英文摘要:

Autonomous navigation in crowded, complex urban environments requires interacting with other agents on the road. A common solution to this problem is to use a prediction model to guess the likely future actions of other agents. While this is reasonable, it leads to overly conservative plans because it does not explicitly model the mutual influence of the actions of interacting agents. This paper builds a reinforcement learning-based method named MIDAS where an ego-agent learns to affect the control actions of other cars in urban driving scenarios. MIDAS uses an attention-mechanism to handle an arbitrary number of other agents and includes a "driver-type" parameter to learn a single policy that works across different planning objectives. We build a simulation environment that enables diverse interaction experiments with a large number of agents and methods for quantitatively studying the safety, efficiency, and interaction among vehicles. MIDAS is validated using extensive experiments and we show that it (i) can work across different road geometries, (ii) results in an adaptive ego policy that can be tuned easily to satisfy performance criteria such as aggressive or cautious driving, (iii) is robust to changes in the driving policies of external agents, and (iv) is more efficient and safer than existing approaches to interaction-aware decision-making.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑