RLPG:基于强化学习的高速公路匝道并道动态车队间隙自适应方法
RLPG: Reinforcement Learning Approach for Dynamic Intra-Platoon Gap Adaptation for Highway On-Ramp Merging
摘要:
车队是指一组使用自动驾驶技术在非常近的距离内行驶的车辆。由于其在提高燃油效率、驾驶安全性和驾驶员舒适性方面的巨大能力,队列技术已经引起了自动驾驶汽车研究界的极大关注。虽然非常有利,但最近的研究发现,过小的排内间隙会阻碍高速公路入口匝道合并期间的交通流。虽然现有的基于控制的方法允许适应车队内间隙以改善交通流,但由于大量的计算复杂性,在交通条件的复杂动态下做出最优控制决策仍然是一个挑战。在本文中,我们提出了一种新的强化学习框架的设计,实施和评估,自适应地调整一个单独的队列成员的队列内间隙,以最大限度地提高交通流量,以应对动态变化的,复杂的交通条件的高速公路入口匝道合并。该框架的状态空间已经精心设计的咨询与运输文献,考虑到关键的交通参数,承担直接相关的合并效率。提出了一种基于深度确定性策略梯度算法的队列间隙决策方法,该方法引入连续的动作空间,保证队列间隙的精确和连续适应。一个广泛的仿真研究表明,有效的强化学习为基础的方法显着改善交通流量在各种高速公路入口匝道合并的情况下。
英文摘要:
A platoon refers to a group of vehicles traveling together in very close proximity using automated driving technology. Owing to its immense capacity to improve fuel efficiency, driving safety, and driver comfort, platooning technology has garnered substantial attention from the autonomous vehicle research community. Although highly advantageous, recent research has uncovered that an excessively small intra-platoon gap can impede traffic flow during highway on-ramp merging. While existing control-based methods allow for adaptation of the intra-platoon gap to improve traffic flow, making an optimal control decision under the complex dynamics of traffic conditions remains a challenge due to the massive computational complexity. In this paper, we present the design, implementation, and evaluation of a novel reinforcement learning framework that adaptively adjusts the intra-platoon gap of an individual platoon member to maximize traffic flow in response to dynamically changing, complex traffic conditions for highway on-ramp merging. The framework's state space has been meticulously designed in consultation with the transportation literature to take into account critical traffic parameters that bear direct relevance to merging efficiency. An intra-platoon gap decision making method based on the deep deterministic policy gradient algorithm is created to incorporate the continuous action space to ensure precise and continuous adaptation of the intra-platoon gap. An extensive simulation study demonstrates the effectiveness of the reinforcement learning-based approach for significantly improving traffic flow in various highway on-ramp merging scenarios.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。