arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2303.09070cs.CY
收藏

LCS-TF:基于多Agent深度强化学习改善交通流的智能换道系统

LCS-TF: Multi-Agent Deep Reinforcement Learning-Based Intelligent Lane-Change System for Improving Traffic Flow

Lokesh Chandra Das, Myounggyu Won

摘要:

自主车道变换是自动驾驶汽车设计的关键挑战之一,因为它对交通效率有重要影响。现有的智能车道变换解决方案主要集中在优化自我车辆的性能,从而受到有限的泛化性能。最近的研究已经看到越来越多的兴趣在多智能体强化学习(MARL)为基础的方法,以解决自我车辆为基础的解决方案,通过多个代理的密切协调的限制。虽然基于MARL的方法已经显示出有前途的结果,车道变化的决定对道路段的整体交通流的潜在影响还没有得到充分考虑。在本文中,我们提出了一种新的混合MARL为基础的智能变道系统的自动驾驶汽车设计,共同优化本地性能的自我车辆,随着全球性能集中在一个给定的路段的整体交通流量。通过对相关交通文献的仔细回顾,设计了一种新的状态空间,将自我车辆周围车辆的关键局部交通信息以及负责管理路段的路边单元(RSU)获得的全局交通信息整合在一起。我们创建了一个奖励函数,以确保代理作出有效的车道变换决策,考虑性能的自我车辆和交通流量的整体改善。设计了一种多智能体深度Q网络(DQN)算法,以确定每个智能体有效合作执行换道机动的最佳策略。LCS-TF的性能进行了评估,通过广泛的模拟与国家的最先进的MARL模型进行比较。在交通效率、驾驶安全性和驾驶员舒适性的各个方面,结果表明LCS-TF具有优越的性能。

英文摘要:

Discretionary lane-change is one of the critical challenges for autonomous vehicle (AV) design due to its significant impact on traffic efficiency. Existing intelligent lane-change solutions have primarily focused on optimizing the performance of the ego-vehicle, thereby suffering from limited generalization performance. Recent research has seen an increased interest in multi-agent reinforcement learning (MARL)-based approaches to address the limitation of the ego vehicle-based solutions through close coordination of multiple agents. Although MARL-based approaches have shown promising results, the potential impact of lane-change decisions on the overall traffic flow of a road segment has not been fully considered. In this paper, we present a novel hybrid MARL-based intelligent lane-change system for AVs designed to jointly optimize the local performance for the ego vehicle, along with the global performance focused on the overall traffic flow of a given road segment. With a careful review of the relevant transportation literature, a novel state space is designed to integrate both the critical local traffic information pertaining to the surrounding vehicles of the ego vehicle, as well as the global traffic information obtained from a road-side unit (RSU) responsible for managing a road segment. We create a reward function to ensure that the agents make effective lane-change decisions by considering the performance of the ego vehicle and the overall improvement of traffic flow. A multi-agent deep Q-network (DQN) algorithm is designed to determine the optimal policy for each agent to effectively cooperate in performing lane-change maneuvers. LCS-TF's performance was evaluated through extensive simulations in comparison with state-of-the-art MARL models. In all aspects of traffic efficiency, driving safety, and driver comfort, the results indicate that LCS-TF exhibits superior performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑