arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2012.01841eess.SYcs.SY
收藏

基于深度强化学习的部分连接自动车辆协同控制策略

Partially Connected Automated Vehicle Cooperative Control Strategy with a Deep Reinforcement Learning Approach

Haotian Shi, Yang Zhou, Keshu Wu, Xin Wang, Yangxin Lin, Bin Ran

摘要:

提出了一种基于深度强化学习(DRL)算法的部分连接和自动化交通环境下的连接和自动化车辆(CAV)纵向控制协同策略,提高了混合交通的串稳定性、车辆跟驰效率和能源效率。由于混合交通的序列是组合的,为了减少训练维度和减轻通信负担,我们将混合交通分解成多个子系统,每个子系统由人类驾驶的车辆(HDV),其次是合作的CAV。在此基础上,提出了基于深度强化学习算法的CAV协同控制策略,使CAV能够学习主导HDV的特性,协同做出纵向控制决策,局部改善各子系统的性能,从而提高整个混合交通流的性能。对于训练,应用分布式邻近策略优化以确保所提出的DRL的训练收敛。仿真实验结果表明,该模型具有较强的泛化能力,能够有效抑制车辆的振荡,在不同的车辆穿透率和不同的先导行为下有效地完成车辆跟驰和节能任务.保留字:部分连接自动交通环境,协同控制,深度强化学习,流量振荡抑制,能量效率

英文摘要:

This paper proposes a cooperative strategy of connected and automated vehicles (CAVs) longitudinal control for partially connected and automated traffic environment based on deep reinforcement learning (DRL) algorithm, which enhances the string stability of mixed traffic, car following efficiency, and energy efficiency. Since the sequences of mixed traffic are combinatory, to reduce the training dimension and alleviate communication burdens, we decomposed mixed traffic into multiple subsystems where each subsystem is comprised of human-driven vehicles (HDV) followed by cooperative CAVs. Based on that, a cooperative CAV control strategy is developed based on a deep reinforcement learning algorithm, enabling CAVs to learn the leading HDV's characteristics and make longitudinal control decisions cooperatively to improve the performance of each subsystem locally and consequently enhance performance for the whole mixed traffic flow. For training, a distributed proximal policy optimization is applied to ensure the training convergence of the proposed DRL. To verify the effectiveness of the proposed method, simulated experiments are conducted, which shows the performance of our proposed model has a great generalization capability of dampening oscillations, fulfilling the car following and energy-saving tasks efficiently under different penetration rates and various leading HDVs behaviors. Keywords: partially connected automated traffic environment, cooperative control, deep reinforcement learning, traffic oscillation dampening, energy efficiency

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑