arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.05071cs.CV
收藏

MI-DETR: 一种基于生物启发运动整合的移动红外小目标检测强基线

MI-DETR: A Strong Baseline for Moving Infrared Small Target Detection with Motion Integration

University of Chinese Academy of Sciences(中国科学院大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);ShanghaiTech University(上海科技大学);Beijing Institute of Basic Medical Sciences(北京基础医学研究所)

Nian Liu, Jin Gao, Zhen Liang, Shubo Lin, Sikui Zhang, Fudong Ge, Liang Li, Weiming Hu

AI总结:

MI-DETR通过生物启发的双路径结构,实现高效红外小目标检测,取得优异性能。

摘要:

红外小目标检测(ISTD)具有挑战性,因为微小、低对比度的目标容易被复杂且动态的背景所遮挡。传统多帧方法通常通过深度神经网络隐式学习运动,通常需要额外的运动监督或显式对齐模块。我们提出了运动整合 DETR(MI-DETR),一种生物启发的双路径检测器,每时间步处理一帧红外图像,同时显式建模运动。首先,视网膜启发的细胞自动机(RCA)将原始帧序列转换为在与外观图像相同的像素网格上定义的运动图,使视网膜细胞状的外观路径和巨细胞状的运动路径能够通过一组边界框进行监督,而无需额外的运动标签或对齐操作。其次,视网膜-巨细胞互连(PMI)块促进了两条路径之间的双向特征交互,提供了生物启发的中间互连机制。最后,RT-DETR 解码器在两条路径的特征上进行操作以产生检测结果。令人惊讶的是,我们提出的一种简单而有效的做法在三个常用的ISTD基准上实现了强大的性能。MI-DETR在IRDST-H上实现了70.3%的mAP@50和72.7%的F1(比最佳多帧基线高出26.35 mAP@50),在DAUB-R上实现了98.0%的mAP@50,在ITSDT-15K上实现了88.3%的mAP@50,证明了生物启发的运动-外观整合的有效性。代码可在https://github.com/nliu-25/MI-DETR上获得。

英文摘要:

Detecting moving infrared small targets is challenging because tiny, low-contrast targets occupy few pixels and are easily obscured by dynamic backgrounds. Existing multi-frame methods aggregate temporal information across frames to capture motion. However, dynamic background changes can generate similar motion cues, making it difficult to distinguish between target motion and background interference. Furthermore, even when motion cues are extracted, combining them with current-frame appearance features remains difficult. To address these issues, we propose Motion Integration DETR (MI-DETR), a three-stage framework that explicitly models motion and fuses it with appearance features. First, to suppress background clutter while preserving target-related motion cues, Recurrent Interpretable Motion Cue Aggregation (RIMCA) maintains a recurrent temporal state that accumulates motion across consecutive frames, producing a causal and spatially aligned motion representation. Second, to integrate spatial and temporal information, Pathway Mutual Interaction (PMI) preserves separate appearance and motion pathways while enabling bidirectional feature exchange between them. Finally, an RT-DETR-based detector uses these refined features for end-to-end target localization. Experiments on DAUB-R, ITSDT-15K, and IRDST-H show that explicit motion modeling and pathway interaction effectively improve moving infrared small target detection.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑