arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.04648cs.CV
收藏

UCDNet:基于可靠特征映射的多无人机协同3D目标检测网络

UCDNet: Multi-UAV Collaborative 3D Object Detection Network by Reliable Feature Mapping

Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院空天信息创新研究院);University of Chinese Academy of Sciences(中国科学院大学);Shanghai AI Laboratory(上海人工智能实验室)

Pengju Tian, Peirui Cheng, Yuchao Wang, Zhechao Wang, Zhirui Wang, Menglong Yan, Xue Yang, Xian Sun

AI总结:

针对多无人机协同3D目标检测中2D到3D特征映射不一致的问题,本文提出UCDNet,利用无人机到地面的深度信息作为先验,并设计同源点几何一致性损失进行自监督,在AeroCollab3D和CoPerception-UAVs数据集上分别将mAP提升4.7%和10%。

摘要:

多无人机协同3D目标检测能够通过整合互补信息来感知和理解复杂环境,其应用涵盖交通监控、配送服务和农业管理等领域。然而,航空遥感中极其广阔的观测范围以及多架无人机之间显著的视角差异,使得在多无人机协同3D目标检测范式中实现从2D图像到3D空间的精确且一致的特征映射面临巨大挑战。针对这一问题,我们提出了一种前所未有的基于摄像头的多无人机协同3D目标检测范式,称为UCDNet。具体而言,从无人机到地面的深度信息被明确地用作强先验,为更准确且更具泛化能力的特征映射提供参考。此外,我们设计了一种同源点几何一致性损失作为辅助自监督,它直接影响特征映射模块,从而增强多视角感知的全局一致性。在AeroCollab3D和CoPerception-UAVs数据集上的实验表明,与基线相比,我们的方法分别将mAP提高了4.7%和10%,这证明了UCDNet的优越性。

英文摘要:

Multi-UAV collaborative 3D object detection can perceive and comprehend complex environments by integrating complementary information, with applications encompassing traffic monitoring, delivery services and agricultural management. However, the extremely broad observations in aerial remote sensing and significant perspective differences across multiple UAVs make it challenging to achieve precise and consistent feature mapping from 2D images to 3D space in multi-UAV collaborative 3D object detection paradigm. To address the problem, we propose an unparalleled camera-based multi-UAV collaborative 3D object detection paradigm called UCDNet. Specifically, the depth information from the UAVs to the ground is explicitly utilized as a strong prior to provide a reference for more accurate and generalizable feature mapping. Additionally, we design a homologous points geometric consistency loss as an auxiliary self-supervision, which directly influences the feature mapping module, thereby strengthening the global consistency of multi-view perception. Experiments on AeroCollab3D and CoPerception-UAVs datasets show our method increases 4.7% and 10% mAP respectively compared to the baseline, which demonstrates the superiority of UCDNet.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑