arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.09145eess.SYcs.SY
收藏

混合自主条件下基于强化学习的自适应速度控制器

Reinforcement learning-based adaptive speed controllers in mixed autonomy condition

Han Wang, Hossein Nick Zinat Matin, Maria Laura Delle Monache

AI总结:

针对混合自主交通场景,本文基于强耦合PDE-ODE交通动力学模型,提出Actor-Critic框架下的强化学习自适应速度控制策略,仿真验证其可改善交通流、缓解拥堵。

摘要:

自动驾驶车辆(Automated Vehicles, AVs)融入交通流后,可作为交通流中的执行器发挥作用,有望显著改善交通拥堵。本文提出一种适配混合自主场景的自适应速度控制器,该场景下AVs会与人类驾驶车辆交互。我们采用强耦合偏微分方程与常微分方程(Partial and Ordinary Differential Equations, PDE-ODE)系统对交通动力学建模,其中PDE刻画人类驾驶交通的总体流态,ODE描述AVs的行驶轨迹。我们通过构建在Actor-Critic(AC,演员-评论家)框架下的强化学习(Reinforcement Learning, RL)算法,推导得到AVs的速度策略,该算法与PDE-ODE模型交互以优化AV控制策略。数值仿真结果展示了该控制器对交通模式的影响,表明AVs具备改善交通流、缓解拥堵的潜力。

英文摘要:

The integration of Automated Vehicles (AVs) into traffic flow holds the potential to significantly improve traffic congestion by enabling AVs to function as actuators within the flow. This paper introduces an adaptive speed controller tailored for scenarios of mixed autonomy, where AVs interact with human-driven vehicles. We model the traffic dynamics using a system of strongly coupled Partial and Ordinary Differential Equations (PDE-ODE), with the PDE capturing the general flow of human-driven traffic and the ODE characterizing the trajectory of the AVs. A speed policy for AVs is derived using a Reinforcement Learning (RL) algorithm structured within an Actor-Critic (AC) framework. This algorithm interacts with the PDE-ODE model to optimize the AV control policy. Numerical simulations are presented to demonstrate the controller's impact on traffic patterns, showing the potential of AVs to improve traffic flow and reduce congestion.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑