arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.17601cs.AIcs.LG
收藏

LASIL:面向长期微观交通仿真的学习者感知监督式模仿学习

LASIL: Learner-Aware Supervised Imitation Learning For Long-term Microscopic Traffic Simulation

Alibaba Group(阿里巴巴集团);The University of Hong Kong(香港大学);Centre for Transformative Garment Production(变革性服装生产中心);University of Tennessee, Knoxville(田纳西大学诺克斯维尔分校)

Ke Guo, Zhenwei Miao, Wei Jing, Weiwei Liu, Weizi Li, Dayang Hao, Jia Pan

AI总结:

本文提出学习者感知监督式模仿学习(LASIL),利用变分自编码器建模专家与学习者状态分布以解决协变量偏移,在pNEUMA数据集上实现更真实的短期微观与长期宏观交通仿真。

摘要:

微观交通仿真在交通工程中扮演着至关重要的角色,它能够提供对个体车辆行为和整体交通流的深入洞察。然而,创建一个能够准确复现人类在各种交通条件下驾驶行为的真实仿真器,面临着重大挑战。传统依赖启发式模型的仿真器,由于真实交通环境的复杂性,往往无法提供准确的仿真结果。由于协变量偏移问题,现有的基于模仿学习的仿真器常常难以生成稳定的长期仿真。在本文中,我们提出了一种名为“学习者感知监督式模仿学习”的新方法,以解决多智能体模仿学习中的协变量偏移问题。通过利用变分自编码器同时建模专家和学习者的状态分布,我们的方法增强专家状态,使得增强后的状态能够感知学习者的状态分布。我们的方法应用于城市交通仿真,在真实世界数据集pNEUMA上评估时,在短期微观和长期宏观真实性方面均显著优于现有的最先进基线方法。

英文摘要:

Microscopic traffic simulation plays a crucial role in transportation engineering by providing insights into individual vehicle behavior and overall traffic flow. However, creating a realistic simulator that accurately replicates human driving behaviors in various traffic conditions presents significant challenges. Traditional simulators relying on heuristic models often fail to deliver accurate simulations due to the complexity of real-world traffic environments. Due to the covariate shift issue, existing imitation learning-based simulators often fail to generate stable long-term simulations. In this paper, we propose a novel approach called learner-aware supervised imitation learning to address the covariate shift problem in multi-agent imitation learning. By leveraging a variational autoencoder simultaneously modeling the expert and learner state distribution, our approach augments expert states such that the augmented state is aware of learner state distribution. Our method, applied to urban traffic simulation, demonstrates significant improvements over existing state-of-the-art baselines in both short-term microscopic and long-term macroscopic realism when evaluated on the real-world dataset pNEUMA.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑