arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2008.10989cs.LG
收藏

拥挤的城市网络对信号设置不敏感:对基于学习的控制的影响

Congested Urban Networks Tend to Be Insensitive to Signal Settings: Implications for Learning-Based Control

Georgia Institute of Technology(佐治亚理工学院)

Jorge Laval, Hao Zhou

摘要:

本文重点介绍了大型城市网络的几个属性,这些属性可能会对应用于交通信号控制的机器学习方法产生影响。特别是,我们表明,平均网络流量往往是独立的信号控制政策的密度增加。到目前为止,这一特性一直未被发现,这意味着深度强化学习(DRL)方法在拥挤的条件下训练时变得无效,这可能解释了DRL在交通信号控制方面的有限成功。我们的研究结果适用于所有可能的网格网络,这要归功于基于两个网络参数的参数化:连续交通灯之间的预期距离与预期绿灯时间的比率,以及交叉路口的转弯概率。具有不同参数的网络对交通信号控制的响应非常不同。值得注意的是,我们发现,没有控制(即随机策略)可以是一个令人惊讶的大家庭的网络的有效控制策略。转向概率的影响被证明是非常显着的基线和日间行车线政策。它还解释了这些政策所观察到的对称性的损失,这是不被现有的理论所捕获的,这些理论依赖于没有转弯的走廊近似。我们的研究结果还表明,监督学习方法具有巨大的潜力,因为它们只需要很少的例子就可以产生优秀的策略。

英文摘要:

This paper highlights several properties of large urban networks that can have an impact on machine learning methods applied to traffic signal control. In particular, we show that the average network flow tends to be independent of the signal control policy as density increases. This property, which so far has remained under the radar, implies that deep reinforcement learning (DRL) methods becomes ineffective when trained under congested conditions, and might explain DRL's limited success for traffic signal control. Our results apply to all possible grid networks thanks to a parametrization based on two network parameters: the ratio of the expected distance between consecutive traffic lights to the expected green time, and the turning probability at intersections. Networks with different parameters exhibit very different responses to traffic signal control. Notably, we found that no control (i.e. random policy) can be an effective control strategy for a surprisingly large family of networks. The impact of the turning probability turned out to be very significant both for baseline and for DRL policies. It also explains the loss of symmetry observed for these policies, which is not captured by existing theories that rely on corridor approximations without turns. Our findings also suggest that supervised learning methods have enormous potential as they require very little examples to produce excellent policies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑