arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.24930cs.RO
收藏

CROSS: 一种用于通用大规模交通信号控制的专家混合强化学习框架

CROSS: A Mixture-of-Experts Reinforcement Learning Framework for Generalizable Large-Scale Traffic Signal Control

National University of Singapore(新加坡国立大学);The Chinese University of Hong Kong(香港中文大学)

Xibei Chen, Yifeng Zhang, Yuxiang Xiao, Mingfeng Fan, Maonan Wang, Guillaume Sartoretti

AI总结:

本文提出CROSS框架,通过预测对比聚类和场景自适应MoE模块,提升交通信号控制的泛化能力,实验显示其在SUMO模拟器上表现优于现有方法。

摘要:

近期机器人、自动化和人工智能的进步使城市交通系统朝着智能城市方向发展,部分得益于自适应交通信号控制(ATSC)的发展,其通过动态优化信号阶段来缓解拥堵并优化交通。然而,实现有效且可推广的大型ATSC仍面临挑战,因为交叉口拓扑多样且交通需求模式高度动态复杂。现有基于强化学习的方法通常使用单一共享策略,其有限的表示能力难以捕捉多样化的交通动态并推广到未见环境。为解决这些挑战,我们提出了CROSS,一种基于专家混合(MoE)的去中心化强化学习框架,用于通用ATSC。我们首先引入预测对比聚类(PCC)模块,通过预测短期状态转移来识别潜在交通模式,随后通过聚类和对比学习增强模式级表示。我们进一步设计了场景自适应MoE模块,通过多个专家增强共享策略,从而实现适应性专业化和更灵活的场景特定策略。我们在SUMO模拟器上对合成和真实交通数据集进行了广泛实验。与现有最先进基线相比,CROSS通过改进对多样化交通场景的表示,实现了优越的性能和泛化能力。

英文摘要:

Recent advances in robotics, automation, and artificial intelligence have enabled urban traffic systems to operate with increasing autonomy towards future smart cities, powered in part by the development of adaptive traffic signal control (ATSC), which dynamically optimizes signal phases to mitigate congestion and optimize traffic. However, achieving effective and generalizable large-scale ATSC remains a significant challenge due to the diverse intersection topologies and highly dynamic, complex traffic demand patterns across the network. Existing RL-based methods typically use a single shared policy for all scenarios, whose limited representational capacity makes it difficult to capture diverse traffic dynamics and generalize to unseen environments. To address these challenges, we propose CROSS, a novel Mixture-of-Experts (MoE)-based decentralized RL framework for generalizable ATSC. We first introduce a Predictive Contrastive Clustering (PCC) module that forecasts short-term state transitions to identify latent traffic patterns, followed by clustering and contrastive learning to enhance pattern-level representation. We further design a Scenario-Adaptive MoE module that augments a shared policy with multiple experts, thus enabling adaptive specialization and more flexible scenario-specific strategies. We conduct extensive experiments in the SUMO simulator on both synthetic and real-world traffic datasets. Compared with state-of-the-art baselines, CROSS achieves superior performance and generalization through improved representation of diverse traffic scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑