arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2210.11934cs.IR
收藏

Hybrid Retrieval中融合函数的分析

An Analysis of Fusion Functions for Hybrid Retrieval

Sebastian Bruch, Siyu Gai, Amir Ingber

AI总结:

本文分析了文本检索中混合搜索的融合函数,比较了凸组合(CC)与Reciprocal Rank Fusion(RRF)方法,发现CC在域内外表现更优且样本高效,而RRF对参数敏感。

摘要:

我们研究文本检索中的混合搜索,其中词法搜索和语义搜索被融合在一起,直觉是两者在如何建模相关性方面是互补的。特别地,我们通过词法和语义分数的凸组合(CC)以及Reciprocal Rank Fusion(RRF)方法来检验融合,并识别它们的优势和潜在陷阱。与现有研究相反,我们发现RRF对其参数敏感;CC融合的学习通常对分数归一化的选择不敏感;CC在域内和域外设置中优于RRF;最后,CC是样本高效的,仅需少量训练示例即可将其唯一参数调整到目标域。

英文摘要:

We study hybrid search in text retrieval where lexical and semantic search are fused together with the intuition that the two are complementary in how they model relevance. In particular, we examine fusion by a convex combination (CC) of lexical and semantic scores, as well as the Reciprocal Rank Fusion (RRF) method, and identify their advantages and potential pitfalls. Contrary to existing studies, we find RRF to be sensitive to its parameters; that the learning of a CC fusion is generally agnostic to the choice of score normalization; that CC outperforms RRF in in-domain and out-of-domain settings; and finally, that CC is sample efficient, requiring only a small set of training examples to tune its only parameter to a target domain.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑