arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.04831cs.IR
收藏

第一阶段检索的语义模型综述

Semantic Models for the First-stage Retrieval: A Comprehensive Review

Jiafeng Guo, Yinqiong Cai, Yixing Fan, Fei Sun, Ruqing Zhang, Xueqi Cheng

摘要:

多阶段排序管道已经成为现代搜索系统中的一种实用解决方案,其中第一阶段检索是返回候选文档的子集,并且后面的阶段尝试重新排序这些候选者。与过去几十年中经历快速技术转变的重新排序阶段不同,第一阶段检索长期以来一直由经典的基于术语的模型主导。不幸的是,这些模型遭受词汇不匹配的问题,这可能会阻止重新排序阶段从相关的文件在一开始。因此,长期以来,人们一直希望为第一阶段的检索,可以实现高召回率的语义模型。近年来,人们对第一阶段语义检索模型的研究呈爆炸式增长。我们认为,现在是调查现状、借鉴现有方法并为未来发展提供一些见解的正确时机。在本文中,我们描述了目前的景观的第一阶段检索模型在一个统一的框架下,澄清经典的基于术语的检索方法,早期的语义检索方法和神经语义检索方法之间的联系。此外,我们确定了一些开放的挑战,并设想了一些未来的方向,希望能激发更多的研究,这些重要的,但很少调查的主题。

英文摘要:

Multi-stage ranking pipelines have been a practical solution in modern search systems, where the first-stage retrieval is to return a subset of candidate documents, and latter stages attempt to re-rank those candidates. Unlike re-ranking stages going through quick technique shifts during past decades, the first-stage retrieval has long been dominated by classical term-based models. Unfortunately, these models suffer from the vocabulary mismatch problem, which may block re-ranking stages from relevant documents at the very beginning. Therefore, it has been a long-term desire to build semantic models for the first-stage retrieval that can achieve high recall efficiently. Recently, we have witnessed an explosive growth of research interests on the first-stage semantic retrieval models. We believe it is the right time to survey current status, learn from existing methods, and gain some insights for future development. In this paper, we describe the current landscape of the first-stage retrieval models under a unified framework to clarify the connection between classical term-based retrieval methods, early semantic retrieval methods and neural semantic retrieval methods. Moreover, we identify some open challenges and envision some future directions, with the hope of inspiring more researches on these important yet less investigated topics.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑