arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.02444cs.IRcs.CV

RANKVIDEO: 文本到视频检索中的推理重排序

RANKVIDEO: Reasoning Reranking for Text-to-Video Retrieval

Johns Hopkins University(约翰霍普金斯大学);Human Language Technology Center of Excellence(人机语言技术卓越中心)

Tyler Skow, Alexander Martin, Benjamin Van Durme, Rama Chellappa, Reno Kriz

AI总结:

RANKVIDEO通过基于视频内容的推理机制,提升了文本到视频检索的重排序性能,实验显示在nDCG@10上平均提升31%,优于现有方法。

摘要:

重排序是现代检索系统的关键组成部分,通常将一个高效的初步检索器与更具表达力的模型结合,以细化结果。尽管大规模推理模型在文本中心的重排序中推动了快速进展,但基于推理的视频检索重排序仍处于探索阶段。为了解决这一差距,我们引入了RANKVIDEO,这是一种用于视频检索的基于推理的重排序器,它通过视频内容显式推理查询-视频对以评估相关性。RANKVIDEO通过一个两阶段的课程进行训练,包括基于感知的监督微调,随后是结合点wise、pairwise和教师置信度蒸馏目标的重排序训练,并辅以数据合成管道来构建推理密集型的查询-视频对。在大规模的MultiVENT 2.0基准测试中,实验表明,RANKVIDEO在两阶段框架内一致提高了检索性能,平均在nDCG@10上提高了31%,优于纯文本和视觉-语言重排序替代方案,同时更加高效。

英文摘要:

Reranking is a critical component of modern retrieval systems, which typically pair an efficient first-stage retriever with a more expressive model to refine results. While large reasoning models have driven rapid progress in text-centric reranking, reasoning-based reranking for video retrieval remains underexplored. To address this gap, we introduce RANKVIDEO, a reasoning-based reranker for video retrieval that explicitly reasons over query-video pairs using video content to assess relevance. RANKVIDEO is trained using a two-stage curriculum consisting of perception-grounded supervised fine-tuning followed by reranking training that combines pointwise, pairwise, and teacher confidence distillation objectives, and is supported by a data synthesis pipeline for constructing reasoning-intensive query-video pairs. Experiments on the large-scale MultiVENT 2.0 benchmark demonstrate that RANKVIDEO consistently improves retrieval performance within a two-stage framework, yielding an average improvement of 31% on nDCG@10 and outperforming text-only and vision-language reranking alternatives, while more efficient.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑