arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2504.07441cs.CV

WS-DETR:基于视觉-雷达融合与检测Transformer的鲁棒水面目标检测

WS-DETR: Robust Water Surface Object Detection through Vision-Radar Fusion with Detection Transformer

College of Electronics and Information Engineering, Tongji University(同济大学电子与信息工程学院);Graz University of Technology(格拉茨工业大学);Virtual Vehicle Research(虚拟车辆研究院)

Huilin Yin, Pengyu Wang, Senmao Li, Jun Yan, Daniel Watzenig

AI总结:

针对水面目标检测中边缘模糊、尺度多样及视觉-雷达跨模态冲突问题,提出WS-DETR模型,通过多尺度边缘信息集成、层次化特征聚合、自移动点表示和自适应特征交互融合,在WaterScenes数据集上取得SOTA性能并具备恶劣环境下的鲁棒性。

摘要:

在复杂水域环境中,无人水面艇(USVs)的鲁棒目标检测对于可靠导航与作业至关重要。具体而言,水面目标检测面临边缘模糊和目标尺度多样等挑战。尽管视觉-雷达融合提供了一种可行的解决方案,但现有方法存在跨模态特征冲突问题,从而对模型鲁棒性产生负面影响。为解决这一问题,我们提出了一种鲁棒的视觉-雷达融合模型WS-DETR。具体来说,我们首先引入多尺度边缘信息集成(MSEII)模块以增强边缘感知能力,并引入层次化特征聚合器(HiFA)以提升编码器中的多尺度目标检测能力。然后,我们采用自移动点表示进行连续卷积和残差连接,以在不规则点云数据场景下高效提取不规则特征。为了进一步缓解跨模态冲突,我们引入自适应特征交互融合(AFIF)模块,通过几何对齐和语义融合来整合视觉与雷达特征。在WaterScenes数据集上的大量实验表明,WS-DETR达到了最先进(SOTA)性能,即使在恶劣天气和光照条件下仍保持其优越性。

英文摘要:

Robust object detection for Unmanned Surface Vehicles (USVs) in complex water environments is essential for reliable navigation and operation. Specifically, water surface object detection faces challenges from blurred edges and diverse object scales. Although vision-radar fusion offers a feasible solution, existing approaches suffer from cross-modal feature conflicts, which negatively affect model robustness. To address this problem, we propose a robust vision-radar fusion model WS-DETR. In particular, we first introduce a Multi-Scale Edge Information Integration (MSEII) module to enhance edge perception and a Hierarchical Feature Aggregator (HiFA) to boost multi-scale object detection in the encoder. Then, we adopt self-moving point representations for continuous convolution and residual connection to efficiently extract irregular features under the scenarios of irregular point cloud data. To further mitigate cross-modal conflicts, an Adaptive Feature Interactive Fusion (AFIF) module is introduced to integrate visual and radar features through geometric alignment and semantic fusion. Extensive experiments on the WaterScenes dataset demonstrate that WS-DETR achieves state-of-the-art (SOTA) performance, maintaining its superiority even under adverse weather and lighting conditions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑