arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.00415cs.ROcs.AIcs.CV
收藏

DriveArena:面向自动驾驶的闭环生成式仿真平台

DriveArena: A Closed-loop Generative Simulation Platform for Autonomous Driving

Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Zhejiang University(浙江大学);Shanghai Jiao Tong University(上海交通大学);East China Normal University(华东师范大学);Technical University of Munich(慕尼黑工业大学)

Xuemeng Yang, Licheng Wen, Yukai Ma, Jianbiao Mei, Xin Li, Tiantian Wei, Wenjie Lei, Daocheng Fu, Pinlong Cai, Min Dou, Botian Shi, Liang He, Yong Liu, Yu Qiao

AI总结:

本文提出DriveArena,首个高保真闭环自动驾驶仿真平台,通过Traffic Manager与World Dreamer的模块化协同实现真实场景下的闭环驾驶智能体开发与评估。

摘要:

本文提出了DriveArena,这是首个为在真实场景中导航的驾驶智能体设计的高保真闭环仿真系统。DriveArena具有灵活的模块化架构,允许无缝替换其核心组件:Traffic Manager(交通管理器),一个能够在任意全球街道地图上生成逼真交通流的交通仿真器,以及World Dreamer(世界梦境器),一个具有无限自回归能力的高保真条件生成模型。这种强大的协同作用使任何能够处理真实世界图像的驾驶智能体都能在DriveArena的仿真环境中导航。智能体通过World Dreamer生成的图像感知周围环境,并输出轨迹。这些轨迹被输入Traffic Manager,实现与其他车辆的逼真交互,并生成新的场景布局。最后,最新的场景布局被传回World Dreamer,延续仿真循环。这一迭代过程促进了在高度逼真环境中的闭环探索,为在各种多样且具有挑战性的场景中开发和评估驾驶智能体提供了有价值的平台。DriveArena标志着在利用生成式图像数据构建驾驶仿真平台方面迈出了实质性的一步,为闭环自动驾驶开辟了新的见解。代码将很快在GitHub上发布:https://github.com/PJLab-ADG/DriveArena

英文摘要:

This paper presented DriveArena, the first high-fidelity closed-loop simulation system designed for driving agents navigating in real scenarios. DriveArena features a flexible, modular architecture, allowing for the seamless interchange of its core components: Traffic Manager, a traffic simulator capable of generating realistic traffic flow on any worldwide street map, and World Dreamer, a high-fidelity conditional generative model with infinite autoregression. This powerful synergy empowers any driving agent capable of processing real-world images to navigate in DriveArena's simulated environment. The agent perceives its surroundings through images generated by World Dreamer and output trajectories. These trajectories are fed into Traffic Manager, achieving realistic interactions with other vehicles and producing a new scene layout. Finally, the latest scene layout is relayed back into World Dreamer, perpetuating the simulation cycle. This iterative process fosters closed-loop exploration within a highly realistic environment, providing a valuable platform for developing and evaluating driving agents across diverse and challenging scenarios. DriveArena signifies a substantial leap forward in leveraging generative image data for the driving simulation platform, opening insights for closed-loop autonomous driving. Code will be available soon on GitHub: https://github.com/PJLab-ADG/DriveArena

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑