arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2312.05090eess.SYcs.LGcs.SY
收藏

UniTSA:一种面向V2X交通信号控制的通用强化学习框架

UniTSA: A Universal Reinforcement Learning Framework for V2X Traffic Signal Control

School of Science and Engineering, The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳)理工学院);Shanghai AI Laboratory(上海人工智能实验室);Key Laboratory of Road and Traffic Engineering, Ministry of Education, Tongji University(同济大学道路与交通工程教育部重点实验室);SenseTime Group Limited(商汤集团有限公司)

Maonan Wang, Xi Xiong, Yuheng Kan, Chengcheng Xu, Man-On Pun

AI总结:

本文提出UniTSA通用强化学习框架,通过交叉口矩阵表征状态和交通状态增强方法,使V2X交通信号控制模型能够适应不同结构的交叉口,并通过多配置实验验证其有效性。

摘要:

交通拥堵是城市地区长期存在的问题,这要求开发有效的交通信号控制(TSC)系统。虽然现有基于强化学习(RL)的方法在优化TSC方面已展现出良好的性能,但将这些方法推广到不同结构的交叉口仍具有挑战性。在本工作中,针对车联网(V2X)环境提出了一种通用的基于RL的TSC框架。所提出的框架引入了一种新颖的智能体设计,该设计结合了交叉口矩阵来表征交叉口状态,使所提出的模型适用于多样化的交叉口。为了使所提出的基于RL的框架具备更强的处理各种交叉口结构的能力,专门为信号灯控制系统量身定制了新颖的交通状态增强方法。最后,来自多种交叉口配置的大量实验结果证实了所提出框架的有效性。本工作的源代码可在 https://github.com/wmn7/Universal_Light 获取。

英文摘要:

Traffic congestion is a persistent problem in urban areas, which calls for the development of effective traffic signal control (TSC) systems. While existing Reinforcement Learning (RL)-based methods have shown promising performance in optimizing TSC, it is challenging to generalize these methods across intersections of different structures. In this work, a universal RL-based TSC framework is proposed for Vehicle-to-Everything (V2X) environments. The proposed framework introduces a novel agent design that incorporates a junction matrix to characterize intersection states, making the proposed model applicable to diverse intersections. To equip the proposed RL-based framework with enhanced capability of handling various intersection structures, novel traffic state augmentation methods are tailor-made for signal light control systems. Finally, extensive experimental results derived from multiple intersection configurations confirm the effectiveness of the proposed framework. The source code in this work is available at https://github.com/wmn7/Universal_Light

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑