arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2508.05402cs.ROcs.CV

DistillDrive:基于同构异源规划模型的端到端多模式自动驾驶蒸馏

DistillDrive: End-to-End Multi-Mode Autonomous Driving Distillation by Isomorphic Hetero-Source Planning Model

East China University of Science and Technology(东华大学);SenseAuto Research(SenseAuto研究院);The University of Sydney(悉尼大学)

Rui Yu, Xianghang Zhang, Runkai Zhao, Huaicheng Yan, Meng Wang

AI总结:

提出DistillDrive,通过知识蒸馏和强化学习,利用教师模型的多样化规划实例增强端到端自动驾驶的多模式学习,在nuScenes和NAVSIM上碰撞率降低50%,闭环性能提升3点。

摘要:

端到端自动驾驶近年来发展迅速,对工业界和学术界都产生了深远影响。然而,现有工作过度关注自车状态作为其唯一学习目标,且缺乏面向规划的理解,这限制了整体决策过程的鲁棒性。在本工作中,我们提出了DistillDrive,一种基于知识蒸馏的端到端自动驾驶模型,利用多样化实例模仿来增强多模式运动特征学习。具体而言,我们采用基于结构化场景表示的规划模型作为教师模型,将其多样化的规划实例作为端到端模型的多目标学习目标。此外,我们引入强化学习以增强状态到决策映射的优化,同时利用生成建模构建面向规划的实例,促进潜在空间内的复杂交互。我们在nuScenes和NAVSIM数据集上验证了我们的模型,与基线模型相比,碰撞率降低了50%,闭环性能提升了3个百分点。代码和模型已在https://github.com/YuruiAI/DistillDrive公开提供。

英文摘要:

End-to-end autonomous driving has been recently seen rapid development, exerting a profound influence on both industry and academia. However, the existing work places excessive focus on ego-vehicle status as their sole learning objectives and lacks of planning-oriented understanding, which limits the robustness of the overall decision-making prcocess. In this work, we introduce DistillDrive, an end-to-end knowledge distillation-based autonomous driving model that leverages diversified instance imitation to enhance multi-mode motion feature learning. Specifically, we employ a planning model based on structured scene representations as the teacher model, leveraging its diversified planning instances as multi-objective learning targets for the end-to-end model. Moreover, we incorporate reinforcement learning to enhance the optimization of state-to-decision mappings, while utilizing generative modeling to construct planning-oriented instances, fostering intricate interactions within the latent space. We validate our model on the nuScenes and NAVSIM datasets, achieving a 50\% reduction in collision rate and a 3-point improvement in closed-loop performance compared to the baseline model. Code and model are publicly available at https://github.com/YuruiAI/DistillDrive

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑