具有异质测量率的边界信号周界控制:一种物理正则化多智能体强化学习方法
Perimeter Control with Heterogeneous Metering Rates for Cordon Signals: A Physics-Regularized Multi-Agent Reinforcement Learning Approach
AI总结:
本文提出一种基于物理正则化多智能体强化学习的异质测量率边界信号周界控制方法,通过分解动作空间并编码宏观基本图知识,有效提升了城市路网吞吐量并降低了延迟与碳排放。
摘要:
周界控制(PC)策略已被提出用于解决过饱和情况下的城市道路网络控制问题,其通过基于宏观基本图(MFD)调节受保护网络(PN)的转移流来实现。现有大多数研究中用于边界信号的统一测量率忽略了交叉口层面局部交通状态的差异,这可能导致严重的局部交通拥堵和网络稳定性的下降。针对边界信号采用异质测量率的PC策略允许对周界进行精确控制,但问题的复杂性随PN的规模呈指数级增长。本文利用基于多智能体强化学习(MARL)的交通信号控制框架,将这一考虑边界信号异质测量率的PC问题分解为多智能体合作任务。每个智能体控制位于边界的一个单独信号,与集中式方法相比,降低了控制器的动作空间维度。提出了一种针对MARL框架的物理正则化方法,通过将基于MFD的知识编码到局部智能体的动作价值函数中,确保分布式边界信号控制器能够感知全局网络状态。所提出的PC策略作为一个两阶段系统运行,首先由反馈PC策略检测PN内的整体交通状态,然后通过物理正则化将局部指令分发给MARL框架中的边界信号控制器。通过在微观交通环境中对不同需求模式进行数值测试,所提出的PC策略展现出良好的鲁棒性和可迁移性。在增加网络吞吐量、减少门控链路的分布式延迟以及降低碳排放方面,它优于最先进的反馈PC策略。
英文摘要:
Perimeter Control (PC) strategies have been proposed to address urban road network control in oversaturated situations by regulating the transfer flow of the Protected Network (PN) based on the Macroscopic Fundamental Diagram (MFD). The uniform metering rate for cordon signals in most existing studies overlooks the variance of local traffic states at the intersection level, which may cause severe local traffic congestion and degradation of the network stability. PC strategies with heterogeneous metering rates for cordon signals allow precise control for the perimeter but the complexity of the problem increases exponentially with the scale of the PN. This paper leverages a Multi-Agent Reinforcement Learning (MARL)-based traffic signal control framework to decompose this PC problem, which considers heterogeneous metering rates for cordon signals, into multi-agent cooperation tasks. Each agent controls an individual signal located in the cordon, decreasing the dimension of action space for the controller compared to centralized methods. A physics regularization approach for the MARL framework is proposed to ensure the distributed cordon signal controllers are aware of the global network state by encoding MFD-based knowledge into the action-value functions of the local agents. The proposed PC strategy is operated as a two-stage system, with a feedback PC strategy detecting the overall traffic state within the PN and then distributing local instructions to cordon signals controllers in the MARL framework via the physics regularization. Through numerical tests with different demand patterns in a microscopic traffic environment, the proposed PC strategy shows promising robustness and transferability. It outperforms state-of-the-art feedback PC strategies in increasing network throughput, decreasing distributed delay for gate links, and reducing carbon emissions.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。