arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2512.05511cs.CV
收藏

重新思考红外小目标检测:一种基础驱动的高效范式

Rethinking Infrared Small Target Detection: A Foundation-Driven Efficient Paradigm

Key Laboratory of Opto-Electronic Information Processing, Chinese Academy of Sciences(光电信息处理重点实验室,中国科学院);Shenyang Institute of Automation, Chinese Academy of Sciences(沈阳自动化研究所,中国科学院);University of Chinese Academy of Sciences(中国科学院大学);Sun Yat-sen University(中山大学);Tencent(腾讯);Nankai University(南开大学);MMLab, The Chinese University of Hong Kong(香港中文大学MMLab)

Chuang Yu, Jinmiao Zhao, Yunpeng Liu, Yaokun Li, Xiujun Shu, Yuanhao Feng, Bo Wang, Xiangyu Yue

AI总结:

本文提出FDEP范式,通过基础模型冻结表示与任务特征融合,提升红外小目标检测精度,构建综合评估指标,实现多数据集SOTA性能。

摘要:

尽管大规模视觉基础模型(VFMs)在多样化视觉领域中表现出强大的泛化能力,但其在单帧红外小目标(SIRST)检测中的潜力仍 largely 未被探索。为填补这一空白,我们首次系统地将 VFMs 的冻结表示引入 SIRST 任务,并提出一种基础驱动高效范式(FDEP),该范式可以无缝适应现有的编码器-解码器方法,并在不增加推理开销的情况下显著提高精度。具体而言,设计了一个语义对齐调制融合(SAMF)模块,以实现 VFMs 的全局语义先验与任务特定特征的动态对齐和深度融合。同时,为避免 VFMs 引入的推理时间负担,我们提出了一种基于协作优化的隐式自蒸馏(CO-ISD)策略,通过参数共享和同步反向传播,在主分支和轻量分支之间实现隐式语义转移。此外,为统一碎片化的评估体系,我们构建了一个综合 SIRST 评估(HSE)度量标准,该标准在像素级置信度和目标级鲁棒性上进行多阈值积分评估,为公平的模型比较提供了稳定且全面的基础。大量实验表明,配备我们 FDEP 框架的 SIRST 检测网络在多个公开数据集上实现了最先进的(SOTA)性能。我们的代码可在 https://github.com/YuChuang1205/FDEP-Framework 上获得。

英文摘要:

While large-scale visual foundation models (VFMs) exhibit strong generalization across diverse visual domains, their potential for single-frame infrared small target (SIRST) detection remains largely unexplored. To fill this gap, we first systematically introduce frozen VFM representations into the SIRST task and propose a Foundation-Driven Efficient Paradigm (FDEP), a general and efficient framework compatible with diverse VFMs and SIRST networks, which improves detection accuracy without additional VFM-related inference overhead. Specifically, a Semantic Alignment and Modulated Fusion (SAMF) module is designed to achieve dynamic alignment and deep fusion of the global semantic priors from VFMs with task-specific features. Meanwhile, to avoid the inference-time overhead introduced by VFMs, we propose a Collaborative Optimization-based Implicit Self-Distillation (CO-ISD) strategy, which enables implicit semantic transfer between the main and lightweight branches through parameter sharing and synchronized backpropagation. In addition, to unify the fragmented evaluation system, we construct a Holistic SIRST Evaluation (HSE) metric that performs multi-threshold integral evaluation at both pixel-level confidence and target-level robustness, providing a stable and comprehensive basis for fair model comparison. Extensive experiments demonstrate that the SIRST detection networks equipped with our FDEP framework achieve state-of-the-art (SOTA) performance on multiple public datasets. Our code is available at https://github.com/YuChuang1205/FDEP-Framework

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑