arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.01059cs.CVcs.MM

DRFormer: 一种双正则化双向变换器用于人重识别

DRFormer: A Dual-Regularized Bidirectional Transformer for Person Re-identification

Institute of Network Science and Intelligent Systems, Beijing Jiaotong University, Beijing, China(网络科学与智能系统研究所,北京交通大学,北京,中国);Zhejiang University, Hangzhou, Zhejiang, China(浙江大学,杭州,浙江,中国)

Ying Shu, Pujian Zhan, Huiqi Yang, Hehe Fan, Youfang Lin, Kai Lv

AI总结:

DRFormer通过双正则化双向变换器融合视觉基础模型和视觉-语言模型的优势,提升人重识别的性能。

摘要:

细粒度判别细节和全局语义特征都能帮助解决人重识别挑战,如遮挡和姿态变化。视觉基础模型(例如DINO)擅长挖掘局部纹理,而视觉-语言模型(例如CLIP)捕捉到强的全局语义差异。现有方法主要依赖单一范式,忽视了其整合的潜在优势。在本文中,我们分析了这两种架构的互补作用,并提出了一种框架,通过双正则化双向变换器(DRFormer)来协同增强它们的优点。双正则化机制确保了多样化的特征提取,并在两个模型的贡献之间实现了更好的平衡。在五个基准上的广泛实验表明,我们的方法有效协调了局部和全局表示,取得了与最先进方法相媲美的性能。

英文摘要:

Both fine-grained discriminative details and global semantic features can contribute to solving person re-identification challenges, such as occlusion and pose variations. Vision foundation models (\textit{e.g.}, DINO) excel at mining local textures, and vision-language models (\textit{e.g.}, CLIP) capture strong global semantic difference. Existing methods predominantly rely on a single paradigm, neglecting the potential benefits of their integration. In this paper, we analyze the complementary roles of these two architectures and propose a framework to synergize their strengths by a \textbf{D}ual-\textbf{R}egularized Bidirectional \textbf{Transformer} (\textbf{DRFormer}). The dual-regularization mechanism ensures diverse feature extraction and achieves a better balance in the contributions of the two models. Extensive experiments on five benchmarks show that our method effectively harmonizes local and global representations, achieving competitive performance against state-of-the-art methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑