arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2501.11034cs.IR
收藏

面向图书检索的生成式检索

Generative Retrieval for Book search

Yubao Tang, Ruqing Zhang, Jiafeng Guo, Maarten de Rijke, Shihao Liu, Shuaiqing Wang, Dawei Yin, Xueqi Cheng

AI总结:

针对图书检索中复杂信息与层级结构挑战,提出生成式检索框架GBS,通过数据增强与面向目录的编码,在百度数据集上MRR@20提升9.8%。

摘要:

在图书检索中,应根据查询返回相关的图书信息。图书包含复杂、多方面的信息,如元数据、目录和正文,其中目录提供了章节之间的层级信息。生成式检索(GR)是一种新的检索范式,它将语料库信息整合到单个模型中,以生成与给定查询相关的文档标识符。如何将GR应用于图书检索?由于图书检索的独特特性,直接将GR应用于图书检索是一项挑战:模型需要保留图书复杂、多方面的信息,这增加了对标注数据的需求。将图书信息拆分并视为独立片段集合进行学习可能会导致层级信息的丢失。我们提出了一种有效的图书检索生成式检索框架(GBS),该框架具有两个主要组成部分:数据增强和面向目录的图书编码。对于数据增强,GBS构建多个查询-图书对用于训练;它基于目录、各种形式的图书内容构建多个图书标识符,并模拟真实的图书检索场景,使用多样的伪查询。这包括促进覆盖率的图书标识符增强,使模型能够学习有效索引,以及增强多样性的查询增强,使模型能够学习有效检索。面向目录的图书编码通过双层位置编码和保持注意力机制改进长度外推,以在长序列上维持上下文。在专有的百度数据集上的实验表明,GBS优于强基线,在MRR@20上比最先进的RIPOR方法提高了9.8%。

英文摘要:

In book search, relevant book information should be returned in response to a query. Books contain complex, multi-faceted information such as metadata, outlines, and main text, where the outline provides hierarchical information between chapters and sections. Generative retrieval (GR) is a new retrieval paradigm that consolidates corpus information into a single model to generate identifiers of documents that are relevant to a given query. How can GR be applied to book search? Directly applying GR to book search is a challenge due to the unique characteristics of book search: The model needs to retain the complex, multi-faceted information of the book, which increases the demand for labeled data. Splitting book information and treating it as a collection of separate segments for learning might result in a loss of hierarchical information. We propose an effective Generative retrieval framework for Book Search (GBS) that features two main components: data augmentation and outline-oriented book encoding. For data augmentation, GBS constructs multiple query-book pairs for training; it constructs multiple book identifiers based on the outline, various forms of book contents, and simulates real book retrieval scenarios with varied pseudo-queries. This includes coverage-promoting book identifier augmentation, allowing the model to learn to index effectively, and diversity-enhanced query augmentation, allowing the model to learn to retrieve effectively. Outline-oriented book encoding improves length extrapolation through bi-level positional encoding and retentive attention mechanisms to maintain context over long sequences. Experiments on a proprietary Baidu dataset demonstrate that GBS outperforms strong baselines, achieving a 9.8\% improvement in terms of MRR@20, over the state-of-the-art RIPOR method...

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑