arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.24975cs.IR
收藏

长尾短视频搜索的无偏多模态重排序

Unbiased Multimodal Reranking for Long-Tail Short-Video Search

Zhejiang University(浙江大学);Kuaishou Technology(快手科技)

Wenyi Xu, Feiran Zhu, Songyang Li, Renzhe Zhou, Chao Zhang, Chenglei Dai, Yuren Mao, Yunjun Gao, Yi Zhang

AI总结:

本文提出基于LLM的多模态重排序框架,通过多阶段训练提升长尾查询内容质量,实验显示在AUC、NDCG@K和用户偏好判断等指标上优于基线方法,线上A/B测试验证了其在用户体验和消费指标上的提升效果。

摘要:

快手每日服务数以亿计的搜索请求,短视频搜索质量至关重要。然而,长尾查询受到严重的马太效应影响:稀疏的用户行为数据导致模型放大低质量内容,如软文和浅层内容。近年来,大语言模型(LLM)的进步提供了一种新范式,因其固有的世界知识可提供强大的内容质量评估机制,无论用户交互稀疏。为此,我们提出一种基于LLM的多模态重排序框架,该框架在不依赖真实用户行为的情况下估计用户体验。该方法包括两阶段训练过程:第一阶段使用多模态证据构建高质量标注用于监督微调,第二阶段结合成对偏好优化帮助模型学习候选者间的偏序关系。在推理时,生成的体验分数用于重排序中提升高质量但曝光不足的视频,并进一步通过强化学习指导页面级优化。实验显示,所提方法在离线指标包括AUC、NDCG@K和人类偏好判断上均优于强基线方法。一项覆盖15%流量的在线A/B测试进一步证明了在用户体验和消费指标上的收益,确认了该方法在长尾视频搜索场景中的实用价值。

英文摘要:

Kuaishou serving hundreds of millions of searches daily, the quality of short-video search is paramount. However, it suffers from a severe Matthew effect on long-tail queries: sparse user behavior data causes models to amplify low-quality content such as clickbait and shallow content. The recent advancements in Large Language Models (LLMs) offer a new paradigm, as their inherent world knowledge provides a powerful mechanism to assess content quality, agnostic to sparse user interactions. To this end, we propose a LLM-driven multimodal reranking framework, which estimates user experience without real user behavior. The approach involves a two-stage training process: the first stage uses multimodal evidence to construct high-quality annotations for supervised fine-tuning, while the second stage incorporates pairwise preference optimization to help the model learn partial orderings among candidates. At inference time, the resulting experience scores are used to promote high-quality but underexposed videos in reranking, and further guide page-level optimization through reinforcement learning. Experiments show that the proposed method achieves consistent improvements over strong baselines in offline metrics including AUC, NDCG@K, and human preference judgement. An online A/B test covering 15\% of traffic further demonstrates gains in both user experience and consumption metrics, confirming the practical value of the approach in long-tail video search scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑