arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.01843cs.CV
收藏

SPIRIT:为统一单帧和多帧红外小目标检测适应视觉基础模型

SPIRIT: Adapting Vision Foundation Models for Unified Single- and Multi-Frame Infrared Small Target Detection

Xidian University(西安电子科技大学);Shanghai Academy of Spaceflight Technology(上海航天技术研究院)

Qian Xu, Xi Li, Fei Gao, Jie Guo, Haojuan Yuan, Shuaipeng Fan, Mingjin Zhang

AI总结:

SPIRIT通过轻量级物理指导插件适应视觉基础模型,解决红外小目标检测中语义与外观差异导致的特征模糊和关联不准确问题,实现单帧与多帧检测的统一。

摘要:

红外小目标检测(IRSTD)对监视和早期预警至关重要,其应用范围涵盖单帧分析和视频模式跟踪。一个实用的解决方案应利用视觉基础模型(VFMs)来缓解红外数据稀缺问题,同时采用基于内存-注意力的时序传播框架,统一单帧和多帧推断。然而,红外小目标具有弱辐射信号和有限的语义线索,这与可见光谱图像有显著差异。这种模态差距使得直接使用以语义为导向的VFMs和基于外观的跨帧关联不可靠:层次特征聚合可能淹没局部目标峰值,而仅基于外观的内存注意力会变得模糊,导致虚假的杂波关联。为了解决这些挑战,我们提出了SPIRIT,一个统一且与VFM兼容的框架,通过轻量级的物理指导插件适应VFMs以适应IRSTD。在空间上,PIFR通过近似秩稀疏分解来细化特征,以抑制结构背景成分并增强稀疏目标信号。在时间上,PGMA将历史推导的软空间先验注入内存跨注意力中,以约束跨帧关联,从而实现稳健的视频检测,同时在时间上下文缺失时自然退化为单帧推断。在多个IRSTD基准测试中的实验显示,与基于VFM的基线和最先进方法相比,取得了持续的改进。

英文摘要:

Infrared small target detection (IRSTD) is crucial for surveillance and early-warning, with deployments spanning both single-frame analysis and video-mode tracking. A practical solution should leverage vision foundation models (VFMs) to mitigate infrared data scarcity, while adopting a memory-attention-based temporal propagation framework that unifies single- and multi-frame inference. However, infrared small targets exhibit weak radiometric signals and limited semantic cues, which differ markedly from visible-spectrum imagery. This modality gap makes direct use of semantics-oriented VFMs and appearance-driven cross-frame association unreliable for IRSTD: hierarchical feature aggregation can submerge localized target peaks, and appearance-only memory attention becomes ambiguous, leading to spurious clutter associations. To address these challenges, we propose SPIRIT, a unified and VFM-compatible framework that adapts VFMs to IRSTD via lightweight physics-informed plug-ins. Spatially, PIFR refines features by approximating rank-sparsity decomposition to suppress structured background components and enhance sparse target-like signals. Temporally, PGMA injects history-derived soft spatial priors into memory cross-attention to constrain cross-frame association, enabling robust video detection while naturally reverting to single-frame inference when temporal context is absent. Experiments on multiple IRSTD benchmarks show consistent gains over VFM-based baselines and SOTA performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑