arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2511.07301cs.CVcs.AI

超越边界:利用视觉基础模型进行无源目标检测

Beyond Boundaries: Leveraging Vision Foundation Models for Source-Free Object Detection

Huizai Yao, Sicheng Zhao, Pengteng Li, Yi Cui, Shuo Lu, Weiyu Guo, Yunfan Lu, Yijie Xu, Hui Xiong

AI总结:

本文提出一种利用视觉基础模型提升无源目标检测性能的新框架,通过增强特征对齐和标签质量,实现跨领域迁移和辨别性提升。

摘要:

无源目标检测(SFOD)旨在将预训练的源模型适配到目标领域,而无需访问源数据。然而,现有SFOD方法主要依赖于源模型的内部知识,这限制了其跨领域泛化能力,往往导致偏见的伪标签,从而阻碍了迁移性和辨别性。相比之下,视觉基础模型(VFMs)在大规模和多样化数据上预训练,具有强大的感知能力和广泛的泛化能力,但其潜力在SFOD设置中仍未被充分挖掘。在本文中,我们提出了一种新的SFOD框架,利用VFMs作为外部知识源,共同增强特征对齐和标签质量。具体来说,我们设计了三个基于VFM的模块:(1)基于补丁相似度加权的全局特征对齐(PGFA)通过使用补丁相似度加权来提取VFM的全局特征,以增强全局特征的迁移性;(2)基于原型的实例特征对齐(PIFA)通过使用动量更新的VFM原型进行实例级对比学习;(3)双源增强伪标签融合(DEPF)通过熵感知策略融合检测VFM和教师模型的预测,以产生更可靠的监督。在六个基准测试上的广泛实验表明,我们的方法在SFOD性能上取得了最先进的结果,验证了将VFM整合以同时提高迁移性和辨别性的有效性。

英文摘要:

Source-Free Object Detection (SFOD) aims to adapt a source-pretrained object detector to a target domain without access to source data. However, existing SFOD methods predominantly rely on internal knowledge from the source model, which limits their capacity to generalize across domains and often results in biased pseudo-labels, thereby hindering both transferability and discriminability. In contrast, Vision Foundation Models (VFMs), pretrained on massive and diverse data, exhibit strong perception capabilities and broad generalization, yet their potential remains largely untapped in the SFOD setting. In this paper, we propose a novel SFOD framework that leverages VFMs as external knowledge sources to jointly enhance feature alignment and label quality. Specifically, we design three VFM-based modules: (1) Patch-weighted Global Feature Alignment (PGFA) distills global features from VFMs using patch-similarity-based weighting to enhance global feature transferability; (2) Prototype-based Instance Feature Alignment (PIFA) performs instance-level contrastive learning guided by momentum-updated VFM prototypes; and (3) Dual-source Enhanced Pseudo-label Fusion (DEPF) fuses predictions from detection VFMs and teacher models via an entropy-aware strategy to yield more reliable supervision. Extensive experiments on six benchmarks demonstrate that our method achieves state-of-the-art SFOD performance, validating the effectiveness of integrating VFMs to simultaneously improve transferability and discriminability.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑