arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2502.03230cs.CVcs.MM
收藏

面向基于文本的人员异常搜索的高效视觉语言模型微调

Efficient Vision Language Model Fine-tuning for Text-based Person Anomaly Search

School of Computer Science and Information Engineering, Hefei University of Technology(合肥工业大学计算机与信息工程学院)

Jiayi He, Shengeng Tang, Ao Liu, Lechao Cheng, Jingjing Wu, Yanyan Wei

AI总结:

本文针对WWW 2025 TPAS挑战赛,提出相似性覆盖分析(SCA)策略,通过高效微调视觉语言模型,提升对相似文本描述下行人异常行为的识别准确性与可靠性。

摘要:

本文介绍了HFUT-LMC团队针对WWW 2025基于文本的人员异常搜索(TPAS)挑战赛的解决方案。该挑战赛的主要目标是在大规模行人图像库中准确识别表现出正常或异常行为的行人。与传统的视频分析任务不同,TPAS特别强调理解和解释文本描述与视觉数据之间的细微关系。该任务的复杂性在于,模型不仅需要在海量图像数据集中将个体与文本描述进行匹配,还需要在面对相似描述时准确区分搜索结果。为了克服这些挑战,我们引入了相似性覆盖分析(SCA)策略,以解决由相似文本描述引起的识别困难。该策略有效增强了模型处理细微差异的能力,从而提高了搜索的准确性和可靠性。我们提出的解决方案在该挑战赛中表现出色。

英文摘要:

This paper presents the HFUT-LMC team's solution to the WWW 2025 challenge on Text-based Person Anomaly Search (TPAS). The primary objective of this challenge is to accurately identify pedestrians exhibiting either normal or abnormal behavior within a large library of pedestrian images. Unlike traditional video analysis tasks, TPAS significantly emphasizes understanding and interpreting the subtle relationships between text descriptions and visual data. The complexity of this task lies in the model's need to not only match individuals to text descriptions in massive image datasets but also accurately differentiate between search results when faced with similar descriptions. To overcome these challenges, we introduce the Similarity Coverage Analysis (SCA) strategy to address the recognition difficulty caused by similar text descriptions. This strategy effectively enhances the model's capacity to manage subtle differences, thus improving both the accuracy and reliability of the search. Our proposed solution demonstrated excellent performance in this challenge.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑