arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2411.11252cs.ROcs.CV
收藏

DrivingSphere:构建用于闭环仿真的高保真4D世界

DrivingSphere: Building a High-fidelity 4D World for Closed-loop Simulation

University of Macau(澳门大学);Li Auto Inc.(理想汽车);Beijing Institute of Technology(北京理工大学)

Tianyi Yan, Dongming Wu, Wencheng Han, Junpeng Jiang, Xia Zhou, Kun Zhan, Cheng-zhong Xu, Jianbing Shen

AI总结:

针对自动驾驶开环仿真无法评估动态决策及现有闭环仿真难以处理视觉输入的问题,提出高保真闭环仿真框架DrivingSphere,通过构建4D世界表示并生成可控的真实多视角视频场景,全面验证并推动自动驾驶算法发展。

摘要:

自动驾驶评估需要能紧密复刻真实路况的仿真环境,包括真实世界的传感器数据和响应式反馈回路。然而,许多现有仿真需要在公开数据集上预测固定路线的路径点或处理合成光真实数据,即开环仿真通常缺乏评估动态决策的能力。尽管近期闭环仿真的努力提供了反馈驱动的环境,但它们无法处理视觉传感器输入,也无法产生与真实世界数据不同的输出。为应对这些挑战,我们提出了DrivingSphere,一个真实的闭环仿真框架。其核心思想是构建4D世界表示并生成真实且可控的驾驶场景。具体而言,我们的框架包括一个动态环境组合模块,它以占据格式构建一个详细的4D驾驶世界,配备静态背景和动态物体;以及一个视觉场景合成模块,将该数据转换为高保真、多视角视频输出,确保时空一致性。通过提供动态且真实的仿真环境,DrivingSphere能够对自动驾驶算法进行全面测试和验证,最终推动更可靠自动驾驶汽车的发展。该基准将公开发布。

英文摘要:

Autonomous driving evaluation requires simulation environments that closely replicate actual road conditions, including real-world sensory data and responsive feedback loops. However, many existing simulations need to predict waypoints along fixed routes on public datasets or synthetic photorealistic data, \ie, open-loop simulation usually lacks the ability to assess dynamic decision-making. While the recent efforts of closed-loop simulation offer feedback-driven environments, they cannot process visual sensor inputs or produce outputs that differ from real-world data. To address these challenges, we propose DrivingSphere, a realistic and closed-loop simulation framework. Its core idea is to build 4D world representation and generate real-life and controllable driving scenarios. In specific, our framework includes a Dynamic Environment Composition module that constructs a detailed 4D driving world with a format of occupancy equipping with static backgrounds and dynamic objects, and a Visual Scene Synthesis module that transforms this data into high-fidelity, multi-view video outputs, ensuring spatial and temporal consistency. By providing a dynamic and realistic simulation environment, DrivingSphere enables comprehensive testing and validation of autonomous driving algorithms, ultimately advancing the development of more reliable autonomous cars. The benchmark will be publicly released.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑