arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2007.02794stat.MLcs.LG
收藏

基于多智能体图强化学习的高效互联自动驾驶系统

Efficient Connected and Automated Driving System with Multi-agent Graph Reinforcement Learning

McGill University(麦吉尔大学)

Tianyu Shi, Jiawei Wang, Yuankai Wu, Luis Miranda-Moreno, Lijun Sun

摘要:

互联和自动驾驶汽车(CAV)最近引起了越来越多的关注。快速的驱动时间使它们具有提高整个运输系统的效率和安全性的潜力。由于技术挑战,将有一部分车辆可以配备自动化,而其他车辆则没有自动化。我们不是学习自我自动驾驶汽车的可靠行为,而是专注于如何通过让每个自动驾驶汽车学习相互合作并调节人类驾驶的交通流量来改善整个交通系统的结果。最先进的方法之一是使用强化学习来学习智能决策策略。然而,直接强化学习框架不能提高整个系统的性能。在这篇文章中,我们证明,考虑问题的多代理设置共享的政策,可以帮助实现更好的系统性能比非共享的政策,在单代理设置。此外,我们发现,利用注意力机制的互动功能,可以捕捉每个代理之间的相互作用,以促进合作。据我们所知,虽然以前的自动驾驶研究主要集中在提高个人的驾驶性能,这项工作作为一个起点,系统级的多智能体合作性能的研究,使用图形信息共享。我们进行了广泛的实验,在汽车跟随和无信号交叉口设置。结果表明,我们的方法控制的CAV可以达到最佳的性能对几个国家的最先进的基线。

英文摘要:

Connected and automated vehicles (CAVs) have attracted more and more attention recently. The fast actuation time allows them having the potential to promote the efficiency and safety of the whole transportation system. Due to technical challenges, there will be a proportion of vehicles that can be equipped with automation while other vehicles are without automation. Instead of learning a reliable behavior for ego automated vehicle, we focus on how to improve the outcomes of the total transportation system by allowing each automated vehicle to learn cooperation with each other and regulate human-driven traffic flow. One of state of the art method is using reinforcement learning to learn intelligent decision making policy. However, direct reinforcement learning framework cannot improve the performance of the whole system. In this article, we demonstrate that considering the problem in multi-agent setting with shared policy can help achieve better system performance than non-shared policy in single-agent setting. Furthermore, we find that utilization of attention mechanism on interaction features can capture the interplay between each agent in order to boost cooperation. To the best of our knowledge, while previous automated driving studies mainly focus on enhancing individual's driving performance, this work serves as a starting point for research on system-level multi-agent cooperation performance using graph information sharing. We conduct extensive experiments in car-following and unsignalized intersection settings. The results demonstrate that CAVs controlled by our method can achieve the best performance against several state of the art baselines.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑