arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.15751cs.AI
收藏

用于自适应交通信号控制的强化学习:基于轮次和基于时间的方法以减少拥堵

Reinforcement Learning for Adaptive Traffic Signal Control: Turn-Based and Time-Based Approaches to Reduce Congestion

National University of Sciences & Technology(国家科技大学)

Muhammad Tahir Rafique, Ahmed Mustafa, Hasan Sajid

AI总结:

本文提出两种基于强化学习的自适应交通信号控制算法,分别按实时队列长度动态优先信号和按交通状况调整相位时长,在四个场景中验证其显著优于传统系统,可高效缓解拥堵。

摘要:

城市地区道路使用需求的不断增长导致了严重的交通拥堵,仅靠基础设施扩建来缓解这一问题成本高昂,带来了诸多挑战。作为一种替代方案,优化现有交通管理系统,尤其是通过自适应交通信号控制,提供了一种有前景的解决方案。本文探讨了使用强化学习(RL)来增强交叉口交通信号运行的方法,旨在无需大规模传感器网络的情况下减少拥堵。我们引入了两种基于强化学习的算法:一种是基于轮次的智能体,它根据实时队列长度动态确定交通信号的优先级;另一种是基于时间的智能体,它在遵循固定相位循环的同时,根据交通状况调整信号相位持续时间。通过将状态表示为标量队列长度,我们的方法简化了学习过程并降低了部署成本。这些算法在四个不同的交通场景中进行了测试,并使用七个评估指标来全面评估性能。仿真结果表明,两种强化学习算法均显著优于传统交通信号控制系统,凸显了它们高效改善城市交通流的潜力。

英文摘要:

The growing demand for road use in urban areas has led to significant traffic congestion, posing challenges that are costly to mitigate through infrastructure expansion alone. As an alternative, optimizing existing traffic management systems, particularly through adaptive traffic signal control, offers a promising solution. This paper explores the use of Reinforcement Learning (RL) to enhance traffic signal operations at intersections, aiming to reduce congestion without extensive sensor networks. We introduce two RL-based algorithms: a turn-based agent, which dynamically prioritizes traffic signals based on real-time queue lengths, and a time-based agent, which adjusts signal phase durations according to traffic conditions while following a fixed phase cycle. By representing the state as a scalar queue length, our approach simplifies the learning process and lowers deployment costs. The algorithms were tested in four distinct traffic scenarios using seven evaluation metrics to comprehensively assess performance. Simulation results demonstrate that both RL algorithms significantly outperform conventional traffic signal control systems, highlighting their potential to improve urban traffic flow efficiently.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑