arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.24587cs.LGcs.RO
收藏

DreamerAD:通过潜在世界模型实现高效的强化学习用于自动驾驶

DreamerAD: Efficient Reinforcement Learning via Latent World Model for Autonomous Driving

Institute of Automation, CAS(中国科学院自动化研究所);Chongqing Chang’an Technology Co., Ltd(重庆长安科技有限公司);School of Advanced Interdisciplinary Sciences, UCAS(中国科学院大学先进交叉科学学院);School of Artificial Intelligence, UCAS(中国科学院大学人工智能学院)

Pengxuan Yang, Yupeng Zheng, Deheng Qian, Zebin Xing, Qichao Zhang, Linbo Wang, Yichen Zhang, Shaoyu Guo, Zhongpu Xia, Qiang Chen, Junyu Han, Lingyun Xu, Yifeng Pan, Dongbin Zhao

AI总结:

DreamerAD通过压缩扩散采样将步骤从100步减少到1步,实现80倍加速并保持视觉可解释性,解决了自动驾驶中真实世界数据训练成本高和安全风险大的问题。

摘要:

我们介绍了DreamerAD,首个能够通过压缩扩散采样将步骤从100步减少到1步,实现80倍加速并保持视觉可解释性的潜在世界模型框架,用于自动驾驶中的高效强化学习。在真实世界驾驶数据上训练RL策略会带来高昂的成本和安全风险。尽管现有的像素级扩散世界模型能够实现安全的基于想象的训练,但多步扩散推断延迟(2秒/帧)阻碍了高频RL交互。我们的方法利用视频生成模型的去噪潜在特征,通过三个关键机制:(1)shortcut forcing通过递归多分辨率步骤压缩减少采样复杂性;(2)一个自回归密集奖励模型直接在潜在表示上进行细粒度信用分配;(3)高斯词汇采样用于GRPO,将探索限制在物理上合理的轨迹上。DreamerAD在NavSim v2上实现了87.7 EPDMS,建立了最先进的性能,并证明了潜在空间RL在自动驾驶中的有效性。

英文摘要:

We introduce DreamerAD, the first latent world model framework that enables efficient reinforcement learning for autonomous driving by compressing diffusion sampling from 100 steps to 1 - achieving 80x speedup while maintaining visual interpretability. Training RL policies on real-world driving data incurs prohibitive costs and safety risks. While existing pixel-level diffusion world models enable safe imagination-based training, they suffer from multi-step diffusion inference latency (2s/frame) that prevents high-frequency RL interaction. Our approach leverages denoised latent features from video generation models through three key mechanisms: (1) shortcut forcing that reduces sampling complexity via recursive multi-resolution step compression, (2) an autoregressive dense reward model operating directly on latent representations for fine-grained credit assignment, and (3) Gaussian vocabulary sampling for GRPO that constrains exploration to physically plausible trajectories. DreamerAD achieves 87.7 EPDMS on NavSim v2, establishing state-of-the-art performance and demonstrating that latent-space RL is effective for autonomous driving.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑