arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2306.04660cs.LGcs.AI
收藏

基于混合Actor-Critic强化学习的自适应频率绿灯最优速度建议

Adaptive Frequency Green Light Optimal Speed Advisory based on Hybrid Actor-Critic Reinforcement Learning

Software College, Liaoning Technical University(辽宁工程技术大学软件学院)

Ming Xu, Dongyu Zuo

AI总结:

针对现有绿灯最优速度建议系统存在建议冗余或无法适配动态交通的问题,提出基于混合近端策略优化的自适应频率GLOSA模型,通过混合actor网络输出控制间隔与加速度曲线,结合兼顾效率与油耗的奖励函数,在仿真中实现了停车时间、油耗和碳排放的更优降低效果。

摘要:

绿灯最优速度建议(Green Light Optimal Speed Advisory, GLOSA)系统为车辆提供速度建议,辅助车辆在绿灯时段通过交叉口,通过最大限度减少交叉口的停车次数和怠速时间来缓解交通拥堵、降低燃油消耗。然而,以往研究聚焦于优化GLOSA算法,却忽略了GLOSA系统的速度建议频率。具体而言,部分研究在每个决策步都输出速度建议曲线,导致建议冗余;另一些研究仅为车辆计算一次最优速度,无法适应动态交通。本文提出一种基于混合近端策略优化(Hybrid Proximal Policy Optimization, H-PPO)方法的自适应频率GLOSA(Adaptive Frequency GLOSA, AF-GLOSA)模型,该模型采用带混合actor网络的actor-critic架构。混合actor网络由输出控制间隔的离散actor和输出加速度曲线的连续actor组成。此外,我们设计了一种同时考虑通行效率和燃油消耗的新型奖励函数。我们在SUMO仿真平台的一个带交通信号灯的三车道交叉口场景中,将AF-GLOSA模型与传统GLOSA方法和基于学习的GLOSA方法进行对比评估。结果表明,AF-GLOSA模型在减少平均停车时间、降低燃油消耗和CO₂排放方面表现最优。

英文摘要:

Green Light Optimal Speed Advisory (GLOSA) system suggests speeds to vehicles to assist them in passing through intersections during green intervals, thus reducing traffic congestion and fuel consumption by minimizing the number of stops and idle times at intersections. However, previous research has focused on optimizing the GLOSA algorithm, neglecting the frequency of speed advisory by the GLOSA system. Specifically, some studies provide speed advisory profile at each decision step, resulting in redundant advisory, while others calculate the optimal speed for the vehicle only once, which cannot adapt to dynamic traffic. In this paper, we propose an Adaptive Frequency GLOSA (AF-GLOSA) model based on Hybrid Proximal Policy Optimization (H-PPO) method, which employs an actor-critic architecture with a hybrid actor network. The hybrid actor network consists of a discrete actor that outputs control gap and a continuous actor that outputs acceleration profiles. Additionally, we design a novel reward function that considers both travel efficiency and fuel consumption. The AF-GLOSA model is evaluated in comparison to traditional GLOSA and learning-based GLOSA methods in a three-lane intersection with a traffic signal in SUMO. The results demonstrate that the AF-GLOSA model performs best in reducing average stop times, fuel consumption and CO2 emissions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑