UCDNet: Multi-UAV Collaborative 3D Object Detection Network by Reliable Feature Mapping
Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院空天信息创新研究院);University of Chinese Academy of Sciences(中国科学院大学);Shanghai AI Laboratory(上海人工智能实验室)
Multi-UAV collaborative 3D object detection can perceive and comprehend complex environments by integrating complementary information, with applications encompassing traffic monitoring, delivery services and agricultural management. However, the extremely broad observations in aerial remote sensing and significant perspective differences across multiple UAVs make it challenging to achieve precise and consistent feature mapping from 2D images to 3D space in multi-UAV collaborative 3D object detection paradigm. To address the problem, we propose an unparalleled camera-based multi-UAV collaborative 3D object detection paradigm called UCDNet. Specifically, the depth information from the UAVs to the ground is explicitly utilized as a strong prior to provide a reference for more accurate and generalizable feature mapping. Additionally, we design a homologous points geometric consistency loss as an auxiliary self-supervision, which directly influences the feature mapping module, thereby strengthening the global consistency of multi-view perception. Experiments on AeroCollab3D and CoPerception-UAVs datasets show our method increases 4.7% and 10% mAP respectively compared to the baseline, which demonstrates the superiority of UCDNet.
University of Chinese Academy of Sciences (UCAS)(中国科学院大学);Institute of Automation, Chinese Academy of Sciences (CASIA)(中国科学院自动化研究所);New Laboratory of Pattern Recognition (NLPR)(模式识别新实验室);State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS)(多模态人工智能系统国家重点实验室);Beijing University of Posts and Telecommunications (BUPT)(北京邮电大学);Tencent(腾讯)
AeroVerse-SatAgent: UAV-Satellite Collaborative Spatial Reasoning Inspired by the Dual Visual Pathway Theory of Cognitive Neuroscience
Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院空天信息创新研究院);University of Chinese Academy of Sciences(中国科学院大学);School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences(中国科学院大学电子电气与通信工程学院);Key Laboratory of Target Cognition and Application Technology (TCAT), Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院空天信息创新研究院目标认知与应用技术重点实验室);School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机学院)
Collaborative Tracking and Capture of Aerial Object using UAVs
Guidance Control and Decision Systems Laboratory Department of Aerospace Engineering Indian institute of Science(印度科学研究所航空航天工程系制导控制与决策系统实验室);Robert Bosch Center for Cyber Physical Systems Indian Institute of Science(印度科学研究所罗伯特·博世网络物理系统中心)
Is Intermediate Fusion All You Need for UAV-based Collaborative Perception?
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Key Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所认知与决策智能复杂系统重点实验室)