arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.12665eess.SYcs.SY
收藏

抗脆弱边界控制:利用强化学习预见并从中断中获益

Antifragile perimeter control: Thriving on disruptions through reinforcement learning

ETH Zürich(苏黎世联邦理工学院);Technische Hochschule Nürnberg(纽伦堡应用技术大学);Huawei Munich Research Center(华为慕尼黑研究中心)

Linghang Sun, Michail A. Makridis, Alexander Genser, Cristian Axenie, Margherita Grossi, Anastasios Kouvelas

AI总结:

本文提出一种基于抗脆弱理念的交通控制方法,通过深度强化学习算法在交通网络中实现更高效的操作,展现出在中断情况下更高的性能提升和系统鲁棒性。

摘要:

交通运输系统的最优运行常常受到意外中断的威胁。许多依赖数学模型的现有控制策略在现实世界中断中表现不佳,导致与预期效率显著偏离。本研究将抗脆弱概念与基于学习的交通控制策略相结合,以优化城市道路网络在中断下的运行。抗脆弱系统不仅能承受和恢复压力,还能在对抗性事件中增强性能。通过整合由交通状态导数和冗余组成的抗脆弱模块,开发出深度强化学习算法。随后在环形交通网络和真实世界数据案例中进行评估。实验结果表明,所提算法在增加需求和供应中断下,相较于基线方法性能提升达27.6%和41.9%;在中断下分布偏斜度更低,显示出相对于基线的相对抗脆弱性;在观测受限情况下表现有效;并且具有良好的鲁棒性和可迁移性,可与各种先进的RL框架结合使用。所提出的抗脆弱方法具有通用性,有望应用于交通工程以外的领域,为各种学科中的控制系统提供集成方案。

英文摘要:

The optimal operation of transportation systems is often susceptible to unexpected disruptions. Many established control strategies reliant on mathematical models can struggle with real-world disruptions, leading to significant divergence from their anticipated efficiency. This study integrates the cutting-edge concept of antifragility with learning-based traffic control strategies to optimize urban road network operations under disruptions. Antifragile systems not only withstand and recover from stressors but also thrive and enhance performance in the presence of such adversarial events. Incorporating antifragile modules composed of traffic state derivatives and redundancy, a deep reinforcement learning algorithm is developed. Subsequently, it is evaluated in a cordon-shaped transportation network and a case study with real-world data. Promising results highlight that the proposed algorithm provides: (i) superior performance achieving up to 27.6% and 41.9% performance gain over baselines under increasing demand and supply disruptions, (ii) lower distribution skewness under disruptions, demonstrating its relative antifragility against baselines, (iii) effectiveness under limited observability due to real-world data availability constraints, and (iv) the robustness and transferability to be combined with various state-of-the-art RL frameworks. The proposed antifragile methodology is generalizable and holds potential for applications beyond traffic engineering, offering integration into control systems exposed to disruptions across various disciplines.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑