arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2501.02363cs.CVcs.MA

V2X-DGPE:解决域间隙和位姿误差以实现鲁棒的协同3D目标检测

V2X-DGPE: Addressing Domain Gaps and Pose Errors for Robust Collaborative 3D Object Detection

School of Vehicle and Mobility, Tsinghua University(清华大学车辆与 Mobility学院)

Sichao Wang, Ming Yuan, Chuang Zhang, Qing Xu, Lei He, Jianqiang Wang

AI总结:

针对V2X协同感知中异构节点域间隙和位姿误差导致的特征错位问题,提出特征级协同感知框架V2X-DGPE,通过知识蒸馏、特征补偿、异构自注意力及可变形注意力机制提升融合鲁棒性,在DAIR-V2X数据集上达到SOTA检测性能。

摘要:

在V2X协同感知中,异构节点间的域间隙对有效信息融合构成了重大挑战。由延迟和GPS定位噪声引起的位姿误差会导致特征错位,进一步加剧了这一问题。为克服这些挑战,我们提出了V2X-DGPE,一个高精度且鲁棒的V2X特征级协同感知框架。V2X-DGPE采用知识蒸馏框架和特征补偿模块,从多源数据中学习域不变表示,有效减小了车辆与路边基础设施间的特征分布间隙。利用历史信息使模型对当前场景有更全面的理解。此外,协同融合模块利用异构自注意力机制,提取并整合来自车辆和基础设施的异构表示。为解决位姿误差,V2X-DGPE引入了可变形注意力机制,通过动态偏移采样点,使模型能够自适应地聚焦于输入特征的关键部分。在真实世界DAIR-V2X数据集上的大量实验表明,所提方法优于现有方法,实现了最先进的检测性能。代码可在https://github.com/wangsch10/V2X-DGPE获取。

英文摘要:

In V2X collaborative perception, the domain gaps between heterogeneous nodes pose a significant challenge for effective information fusion. Pose errors arising from latency and GPS localization noise further exacerbate the issue by leading to feature misalignment. To overcome these challenges, we propose V2X-DGPE, a high-accuracy and robust V2X feature-level collaborative perception framework. V2X-DGPE employs a Knowledge Distillation Framework and a Feature Compensation Module to learn domain-invariant representations from multi-source data, effectively reducing the feature distribution gap between vehicles and roadside infrastructure. Historical information is utilized to provide the model with a more comprehensive understanding of the current scene. Furthermore, a Collaborative Fusion Module leverages a heterogeneous self-attention mechanism to extract and integrate heterogeneous representations from vehicles and infrastructure. To address pose errors, V2X-DGPE introduces a deformable attention mechanism, enabling the model to adaptively focus on critical parts of the input features by dynamically offsetting sampling points. Extensive experiments on the real-world DAIR-V2X dataset demonstrate that the proposed method outperforms existing approaches, achieving state-of-the-art detection performance. The code is available at https://github.com/wangsch10/V2X-DGPE.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑