arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.01696cs.CVcs.AI
收藏

跨模态净化与融合用于小物体RGB-D传输线缺陷检测

Cross-Modal Purification and Fusion for Small-Object RGB-D Transmission-Line Defect Detection

School of Mechatronics Engineering, Harbin Institute of Technology(机械电子工程学院,哈尔滨工业大学);School of Instrument Science and Engineering, Harbin Institute of Technology(仪器科学与工程学院,哈尔滨工业大学);Electric Power Research Institute, Yunnan Power Grid Co., Ltd.(电力研究院,云南电网公司)

Jiaming Cui, Wenqiang Li, Shuai Zhou, Ruifeng Qin, Feng Shen

AI总结:

CMAFNet通过跨模态净化与融合技术,提升小物体RGB-D传输线缺陷检测的精度与效率。

摘要:

传输线缺陷检测由于小规模缺陷、复杂背景和光照变化的主导地位,仍然是自动化无人机检测中的挑战。现有的基于RGB的检测器,尽管有最近的进展,但在有限的色度对比下难以区分几何上细微的缺陷与视觉上相似的背景结构。本文提出CMAFNet,一种跨模态对齐与融合网络,通过一种原理性的净化后再融合范式,整合RGB外观和深度几何。CMAFNet包含一个语义重组模块,通过学习的代码本进行基于字典的特征净化,以抑制模态特定的噪声,同时保留缺陷判别信息,并且一个上下文语义整合框架通过部分通道注意机制捕获全局空间依赖性,以增强结构语义推理。净化阶段内的位置归一化强制执行显式的重建驱动跨模态对齐,确保在融合之前异构特征之间的统计兼容性。在TLRGBD基准测试中,94.5%的实例都是小物体,广泛实验表明,CMAFNet实现了32.2%的mAP@50和12.5%的APs,优于最强基线9.8和4.0个百分点。一个轻量级变体在228 FPS下达到24.8%的mAP50,仅使用4.9M参数,超越所有YOLO基检测器,同时在计算成本显著较低的情况下与变换器基方法相匹配。

英文摘要:

Transmission line defect detection remains challenging for automated UAV inspection due to the dominance of small-scale defects, complex backgrounds, and illumination variations. Existing RGB-based detectors, despite recent progress, struggle to distinguish geometrically subtle defects from visually similar background structures under limited chromatic contrast. This paper proposes CMAFNet, a Cross-Modal Alignment and Fusion Network that integrates RGB appearance and depth geometry through a principled purify-then-fuse paradigm. CMAFNet consists of a Semantic Recomposition Module that performs dictionary-based feature purification via a learned codebook to suppress modality-specific noise while preserving defect-discriminative information, and a Contextual Semantic Integration Framework that captures global spatial dependencies using partial-channel attention to enhance structural semantic reasoning. Position-wise normalization within the purification stage enforces explicit reconstruction-driven cross-modal alignment, ensuring statistical compatibility between heterogeneous features prior to fusion. Extensive experiments on the TLRGBD benchmark, where 94.5% of instances are small objects, demonstrate that CMAFNet achieves 32.2% mAP@50 and 12.5% APs, outperforming the strongest baseline by 9.8 and 4.0 percentage points, respectively. A lightweight variant reaches 24.8% mAP50 at 228 FPS with only 4.9M parameters, surpassing all YOLO-based detectors while matching transformer-based methods at substantially lower computational cost.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑