arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2107.05720cs.IR
收藏

SPLADE:第一阶段排序的稀疏词法扩展模型

SPLADE: Sparse Lexical and Expansion Model for First Stage Ranking

Thibault Formal, Benjamin Piwowarski, Stéphane Clinchant

摘要:

在神经信息检索中,正在进行的研究是针对改进排名管道中的第一检索器。学习密集嵌入进行检索使用有效的近似最近邻方法已被证明工作良好。与此同时,人们对学习文档和查询的稀疏表示越来越感兴趣,这可以继承词袋模型的理想属性,例如术语的精确匹配和倒排索引的效率。在这项工作中,我们提出了一个新的第一阶段排名的基础上显式稀疏正则化和对数饱和效应的长期权重,导致高度稀疏表示和竞争力的结果相对于国家的最先进的密集和稀疏的方法。我们的方法很简单,在单个阶段进行端到端培训。我们还探讨了有效性和效率之间的权衡,通过控制稀疏正则化的贡献。

英文摘要:

In neural Information Retrieval, ongoing research is directed towards improving the first retriever in ranking pipelines. Learning dense embeddings to conduct retrieval using efficient approximate nearest neighbors methods has proven to work well. Meanwhile, there has been a growing interest in learning sparse representations for documents and queries, that could inherit from the desirable properties of bag-of-words models such as the exact matching of terms and the efficiency of inverted indexes. In this work, we present a new first-stage ranker based on explicit sparsity regularization and a log-saturation effect on term weights, leading to highly sparse representations and competitive results with respect to state-of-the-art dense and sparse methods. Our approach is simple, trained end-to-end in a single stage. We also explore the trade-off between effectiveness and efficiency, by controlling the contribution of the sparsity regularization.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑