arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2107.13752cs.IR
收藏

ExpertRank:一种基于专家的多级粗粒度列表排序损失

ExpertRank: A Multi-level Coarse-grained Expert-based Listwise Ranking Loss

Zhizhong Chen, Carsten Eickhoff

摘要:

信息检索的目标是推荐与给定查询最相关的候选文档列表。列表学习通过同时大规模比较各种候选人来训练神经检索模型,提供比成对和逐点方案更具竞争力的性能。现有的列表排序损失将候选文档列表视为整个单元而不进行进一步检查。一些具有中等语义显著性的候选者可能被嘈杂的相似性信号忽略,或者被一些特别显著的候选者遮蔽。因此,现有的排名损失未能充分利用神经检索模型的潜力。为了解决这些问题,我们采用经典的池化技术进行多级粗粒度,并提出ExpertRank,一种新的基于专家的列表排序损失。该方案有三个主要优点:(1)ExpertRank通过模型预测和文档间比较在不同的局部层次上选择突出的候选项,将粗粒度的深刻物理概念引入到信息检索中。(2)ExpertRank通过对传统ListNet的扩展,采用专家混合(MoE)技术,有效地将不同的专家组合在一起。(3)与其他现有的列表学习方法相比,ExpertRank为具有不同复杂度的各种神经检索模型提供了更可靠和更有竞争力的性能,从传统的模型,如KNRM,ConvKNRM,MatchPyramid,到复杂的基于BERT/ALBERT的检索模型。

英文摘要:

The goal of information retrieval is to recommend a list of document candidates that are most relevant to a given query. Listwise learning trains neural retrieval models by comparing various candidates simultaneously on a large scale, offering much more competitive performance than pairwise and pointwise schemes. Existing listwise ranking losses treat the candidate document list as a whole unit without further inspection. Some candidates with moderate semantic prominence may be ignored by the noisy similarity signals or overshadowed by a few especially pronounced candidates. As a result, existing ranking losses fail to exploit the full potential of neural retrieval models. To address these concerns, we apply the classic pooling technique to conduct multi-level coarse graining and propose ExpertRank, a novel expert-based listwise ranking loss. The proposed scheme has three major advantages: (1) ExpertRank introduces the profound physics concept of coarse graining to information retrieval by selecting prominent candidates at various local levels based on model prediction and inter-document comparison. (2) ExpertRank applies the mixture of experts (MoE) technique to combine different experts effectively by extending the traditional ListNet. (3) Compared to other existing listwise learning approaches, ExpertRank produces much more reliable and competitive performance for various neural retrieval models with different complexities, from traditional models, such as KNRM, ConvKNRM, MatchPyramid, to sophisticated BERT/ALBERT-based retrieval models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑