arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1905.04722cs.LGcs.AIstat.ML
收藏

交通信号控制的学习阶段竞赛

Learning Phase Competition for Traffic Signal Control

Pennsylvania State University(宾夕法尼亚州立大学);Zhejiang Univerisity(浙江大学);Shanghai Jiao Tong Univerisity(上海交通大学);Tsinghua Univerisity(清华大学);Shanghai Tianrang Intelligent Technology Co., Ltd(上海天壤智能科技有限公司)

Guanjie Zheng, Yuanhao Xiong, Xinshi Zang, Jie Feng, Hua Wei, Huichu Zhang, Yong Li, Kai Xu, Zhenhui Li

摘要:

越来越多的城市数据和先进的学习技术使人们能够提高城市功能的效率。其中,提高城市交通效率是最突出的课题之一。最近的研究提出了使用强化学习(RL)的交通信号控制。与传统的运输方法严重依赖先验知识不同,强化学习可以直接从反馈中学习。另一方面,如果没有仔细的模型设计,现有的RL方法通常需要很长时间才能收敛,并且学习的模型可能无法适应新的场景。例如,一个为早上的交通训练得很好的模型可能不适用于下午的交通,因为交通流可能会被逆转,导致非常不同的状态表示。在本文中,我们提出了一种称为FRAP的新颖设计,该设计基于交通信号控制中相位竞争的直观原理:当两个交通信号发生冲突时,应优先考虑交通流量较大的一个(即,更高的要求)。通过相位竞争模型,我们的模型实现了不变性的对称情况下,如翻转和旋转的交通流。通过进行全面的实验,我们证明了我们的模型在复杂的全相位选择问题中找到了比现有RL方法更好的解决方案,在训练过程中收敛得更快,并且对于不同的道路结构和交通条件具有更好的泛化能力。

英文摘要:

Increasingly available city data and advanced learning techniques have empowered people to improve the efficiency of our city functions. Among them, improving the urban transportation efficiency is one of the most prominent topics. Recent studies have proposed to use reinforcement learning (RL) for traffic signal control. Different from traditional transportation approaches which rely heavily on prior knowledge, RL can learn directly from the feedback. On the other side, without a careful model design, existing RL methods typically take a long time to converge and the learned models may not be able to adapt to new scenarios. For example, a model that is trained well for morning traffic may not work for the afternoon traffic because the traffic flow could be reversed, resulting in a very different state representation. In this paper, we propose a novel design called FRAP, which is based on the intuitive principle of phase competition in traffic signal control: when two traffic signals conflict, priority should be given to one with larger traffic movement (i.e., higher demand). Through the phase competition modeling, our model achieves invariance to symmetrical cases such as flipping and rotation in traffic flow. By conducting comprehensive experiments, we demonstrate that our model finds better solutions than existing RL methods in the complicated all-phase selection problem, converges much faster during training, and achieves superior generalizability for different road structures and traffic conditions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑