arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2207.04470cs.IR
收藏

使用预训练的Transformers的稀疏成对重新排序

Sparse Pairwise Re-ranking with Pre-trained Transformers

Lukas Gienapp, Maik Fröbe, Matthias Hagen, Martin Potthast

摘要:

成对重新排序模型预测两个文档中的哪一个与查询更相关,然后根据这些偏好聚合最终排名。这通常比直接预测每个文档的相关性值的逐点重新排名模型更有效。然而,成对模型的高推理开销限制了它们的实际应用:通常,对于要重新排序的一组$k$文档,聚合所有$k^2-k$比较对(不包括自比较)的偏好。我们调查是否可以提高成对重新排序的效率,从所有对抽样。在一项探索性研究中,我们评估了三种抽样方法和五种偏好聚合方法。最佳组合允许在可接受的检索有效性损失下进行数量级更少的比较,而竞争有效性已经实现了约三分之一的比较。

英文摘要:

Pairwise re-ranking models predict which of two documents is more relevant to a query and then aggregate a final ranking from such preferences. This is often more effective than pointwise re-ranking models that directly predict a relevance value for each document. However, the high inference overhead of pairwise models limits their practical application: usually, for a set of $k$ documents to be re-ranked, preferences for all $k^2-k$ comparison pairs excluding self-comparisons are aggregated. We investigate whether the efficiency of pairwise re-ranking can be improved by sampling from all pairs. In an exploratory study, we evaluate three sampling methods and five preference aggregation methods. The best combination allows for an order of magnitude fewer comparisons at an acceptable loss of retrieval effectiveness, while competitive effectiveness is already achieved with about one third of the comparisons.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑