arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2604.04183cs.CV

面向极端远距离视频人的规模感知视觉语言适应

Scale-Aware Vision-Language Adaptation for Extreme Far-Distance Video Person Re-identification

Arizona State University(亚利桑那州立大学)

Ashwat Rajbhandari, Bharatesh Chakravarthi

AI总结:

本文提出一种基于CLIP的视觉语言模型,通过升级视觉主干和引入选择性微调机制,提升远距离视频人重识别的鲁棒性,实验表明在DetReIDX基准上取得显著提升。

摘要:

极端远距离视频人重识别(ReID)特别具有挑战性,因为存在尺度压缩、分辨率退化、运动模糊和空地视角不匹配等问题。随着相机高度和主体距离的增加,训练于近距离图像上的模型会显著退化。在本文中,我们研究如何让大规模视觉语言模型在这些条件下可靠运行。从CLIP基础模型出发,我们将视觉主干从ViT-B/16升级到ViT-L/14,并引入主干感知的选性微调以稳定较大Transformer的适应。为解决噪声和低分辨率的跟踪片段,我们引入了轻量级的时间注意力池化机制,以抑制退化帧并强调信息丰富的观察。我们保留基于适配器和提示条件的跨视图学习以缓解空地域移,进一步通过改进的优化和k-互反重排序来细化检索。在DetReIDX压力测试基准上的实验表明,我们的方法在A2G、G2A和A2A任务上分别达到46.69、41.23和22.98的mAP分数,整体mAP为35.73。这些结果表明,结合稳定性导向的适应,大规模视觉语言主干显著提升了极端远距离视频人ReID的鲁棒性。

英文摘要:

Extreme far-distance video person re-identification (ReID) is particularly challenging due to scale compression, resolution degradation, motion blur, and aerial-ground viewpoint mismatch. As camera altitude and subject distance increase, models trained on close-range imagery degrade significantly. In this work, we investigate how large-scale vision-language models can be adapted to operate reliably under these conditions. Starting from a CLIP-based baseline, we upgrade the visual backbone from ViT-B/16 to ViT-L/14 and introduce backbone-aware selective fine-tuning to stabilize adaptation of the larger transformer. To address noisy and low-resolution tracklets, we incorporate a lightweight temporal attention pooling mechanism that suppresses degraded frames and emphasizes informative observations. We retain adapter-based and prompt-conditioned cross-view learning to mitigate aerial-ground domain shifts, and further refine retrieval using improved optimization and k-reciprocal re-ranking. Experiments on the DetReIDX stress-test benchmark show that our approach achieves mAP scores of 46.69 (A2G), 41.23 (G2A), and 22.98 (A2A), corresponding to an overall mAP of 35.73. These results show that large-scale vision-language backbones, when combined with stability-focused adaptation, significantly enhance robustness in extreme far-distance video person ReID.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑