arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2303.10828cs.LGcs.AI
收藏

DataLight:离线数据驱动的交通信号控制

DataLight: Offline Data-Driven Traffic Signal Control

Lanzhou University(兰州大学);Beijing University of Posts and Telecommunications(北京邮电大学);Nagoya University(名古屋大学)

Liang Zhang, Yutong Zhang, Jianming Deng, Chen Li

AI总结:

DataLight提出一种离线数据驱动的交通信号控制方法,利用车辆速度信息构建状态表示与奖励函数,并通过道路分段和序列建模增强状态,实验证明其性能优于现有在线和离线方法。

摘要:

强化学习(RL)已成为解决交通信号控制(TSC)挑战的一种有前景的方案。虽然大多数基于RL的TSC系统通常采用在线方法,频繁与环境进行主动交互,但由于安全性和风险问题,在现实世界中学习此类策略是不切实际的。为应对这些挑战,本研究引入了一种创新的离线数据驱动方法,称为DataLight。DataLight通过捕获环境中的车辆速度信息,采用有效的状态表示和奖励函数。然后,它对道路进行分段以捕获空间信息,并通过序列建模进一步增强空间分段的状态表示。实验结果表明了DataLight的有效性,展示了其相较于最先进的在线和离线TSC方法的优越性能。此外,DataLight在现实世界部署问题方面表现出强大的学习能力。代码可在https://github.com/LiangZhang1996/DataLight获取。

英文摘要:

Reinforcement learning (RL) has emerged as a promising solution for addressing traffic signal control (TSC) challenges. While most RL-based TSC systems typically employ an online approach, facilitating frequent active interaction with the environment, learning such strategies in the real world is impractical due to safety and risk concerns. To tackle these challenges, this study introduces an innovative offline data-driven approach, called DataLight. DataLight employs effective state representations and reward function by capturing vehicular speed information within the environment. It then segments roads to capture spatial information and further enhances the spatially segmented state representations with sequential modeling. The experimental results demonstrate the effectiveness of DataLight, showcasing superior performance compared to both state-of-the-art online and offline TSC methods. Additionally, DataLight exhibits robust learning capabilities concerning real-world deployment issues. The code is available at https://github.com/LiangZhang1996/DataLight.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑