arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2607.08076cs.CVcs.AI

LDFE:用于基于双流 CNN 的 RGB-IR 目标检测的拉普拉斯解耦特征增强模块

LDFE: Laplacian Decoupled Feature Enhancement Block for Dual-Stream CNN-based RGB-IR Object Detection

Beihang University(北京航空航天大学);State Key Laboratory of High-Efficiency Reusable Aerospace Transportation Technology(高效可重复使用航天运输技术国家重点实验室);The School of Astronautics(航天学院);The National Key Laboratory of Integrated Air-Ground Navigation Technologies(集成空天地导航技术国家实验室);The State Key Laboratory of Media Convergence and Communication(媒体融合与传播国家重点实验室);The School of Artificial Intelligence(人工智能学院);Zhongguancun Academy(中关村学院);The School of Automation Science and Electrical Engineering(自动化科学与电气工程学院);Beijing Institute of Control and Electronics Technology(北京控制电子技术研究所);Ningbo Institute of Digital Twin(宁波数字孪生研究所);Eastern Institute of Technology(东部技术研究所);Hangzhou Research Institute, School of Artificial Intelligence(杭州研究院,人工智能学院)

Wenhao Dong, Xiaoyan Luo, Linlin Yang, Haodong Zhu, Xiaorong Shi, Guodong Guo, Baochang Zhang

AI总结:

研究基于双流 CNN 的 RGB-IR 目标检测问题,提出拉普拉斯解耦特征增强模块 LDFE,通过全局-局部分解等操作融合不同阶段特征,在多个数据集上显著提升目标检测性能,mAP 超 SOTA 方法。

摘要:

RGB 和 IR 图像之间的互补信息可显著提升极端条件下的目标检测性能。现有方法偏好基于 YOLO 的双流 CNN 主干进行特征提取,并聚焦于特征融合设计。本文引入拉普拉斯解耦特征增强模块(LDFE)来融合双流 CNN 主干不同阶段的特征。LDFE 通过全局-局部分解、去噪、融合和重建依次考虑模态和结构特征。首先基于拉普拉斯金字塔分离特征,然后分别基于全局状态空间增强模块(GS2E)和局部卷积相关增强模块(LC2E)去噪融合。GS2E 采用双分支架构抑制主模态噪声并捕获长程依赖,LC2E 抑制局部特征噪声并提取细粒度细节。这些创新设计显著提升了性能,在多个数据集上 mAP 分别超过当前最优方法 6.2%、3.7%、4.7%、2.3%、4.1%和 2.0%。

英文摘要:

The complementary information between RGB and IR images can significantly enhance object detection performance under extreme conditions. Existing methods prefer dual-stream CNN backbones built upon YOLO for feature extraction and focus on the design of feature fusion. In this paper, we introduce the Laplacian Decoupled Feature Enhancement block (LDFE) to fuse features from different stages of the dual-stream CNN backbone. By design, LDFE simultaneously considers the characteristics of modalities and structures for feature fusion by employing global-local decomposition, denoising, fusion, and reconstruction, sequentially. The LDFE first separates features into global and local components based on Laplacian Pyramid, and then performs denoising and fusion based on Global State Space Enhancement module (GS2E) and Local Convolutional Correlation Enhancement module (LC2E) separately. Specifically, the GS2E conducts a two-branch architecture for the main and auxiliary modalities. It dynamically suppresses noise in the main modality through cross-modal attention derived from the auxiliary modality, while employing a State Space Model to capture long-range dependencies within the global feature representations of the main modality. To obtain bidirectional interaction, the two modalities systematically alternate their main/auxiliary roles. Moreover, the LC2E suppresses noise in local features and leverages spatial and channel dimension along with triple convolution to extract fine-grained details for fusion. These innovative designs achieve a significant performance improvement, with mAP surpassing the SOTA methods 6.2%, 3.7%, 4.7%, 2.3%, 4.1% and 2.0% on M3FD, DroneVehicle, LLVIP, FLIR-Aligned, KAIST and VEDAI datasets,respectively.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑