arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~

参数化稠密-稀疏融合用于混合检索:在Qdrant上对BEIR SciFact的排名-分数混合进行调优

Parameterized Dense-Sparse Fusion for Hybrid Retrieval: Tuning a Rank-Score Mix on BEIR SciFact with Qdrant

Satyanarayan Pati, Srikanth Patil

arXiv 2609.22770首次发表:更新:

发表机构

Involead Services Pvt. Ltd.(Involead服务私人有限公司)

机构由 AI 辅助整理,请以论文原文为准。

AI 中文总结

本研究提出参数化稠密-稀疏融合混合检索器,在SciFact上通过网格搜索调优参数,达到0.753 nDCG@10,优于稠密BGE和等权重RRF,并验证系数需按数据集调整。

AI 中文摘要

我们研究了一种参数化混合排序器,它融合了稠密嵌入列表和稀疏词汇列表。该方法具有一个小的显式参数向量:稠密先验 $\alpha \in [0,1]$,分数与排名混合 $\lambda \in [0,1]$,RRF平滑参数 $\kappa > 0$,可选的列表几何系数(每个查询移动 $\alpha$),以及一个路由器边际 $\tau$,可关闭稀疏搜索。我们在SciFact训练集(809个查询)上对这些范围进行网格搜索,并在SciFact测试集(300个)上冻结所选值。调优后的排名-分数混合($\alpha = 0.8$,$\lambda = 0.75$,$\kappa = 20$)在该测试分割上达到0.753 nDCG@10和0.889 recall@10,优于稠密BGE(0.742 / 0.871)和等权重RRF(0.707 nDCG@10)。列表条件化的 $\alpha$ 增加了+0.0006 nDCG;稀疏关闭路由器被同一训练分割拒绝(任何跳过约50%查询的 $\tau$ 都损失了nDCG)。这些系数是数据集特定的。使用相同模型的等权重RRF在九个zip的BEIR宏平均上未超过稠密(0.479 vs. 0.519 nDCG@10)。在所有20个索引单元上独立重复相同的先训练后冻结扫描,在20/20上优于等权重RRF,在16/20上优于稠密(单元平均nDCG@10 0.467 vs. 0.462稠密 vs. 0.420 RRF)。其他语料库应重用这些范围,而不是复制SciFact点。

英文摘要

We study a parameterized hybrid ranker that fuses a dense embedding list and a sparse lexical list. The method has a small, explicit parameter vector: a dense prior $α\in [0,1]$, a score-versus-rank mix $λ\in [0,1]$, an RRF smoothing parameter $κ> 0$, optional list-geometry coefficients that move $α$ per query, and a router margin $τ$ that can turn sparse search off. We grid-search those ranges on SciFact train (809 queries) and freeze the chosen values on SciFact test (300). The tuned rank-score mix ($α= 0.8$, $λ= 0.75$, $κ= 20$) reaches 0.753 nDCG@10 and 0.889 recall@10, outperforming dense BGE (0.742 / 0.871) and equal-weight RRF (0.707 nDCG@10) on that test split. A list-conditioned $α$ adds +0.0006 nDCG; a sparse-off router is rejected by the same train split (any $τ$ that skipped approximately 50% of queries lost nDCG). These coefficients are dataset-specific. Equal RRF with the same models does not beat dense on a nine-zip BEIR macro-average (0.479 vs. 0.519 nDCG@10). Repeating the same train-then-freeze sweep independently on all 20 indexed units beats equal RRF on 20/20 and dense on 16/20 (unit-mean nDCG@10 0.467 vs. 0.462 dense vs. 0.420 RRF). Other corpora should reuse the ranges, not a copy of the SciFact point.

论文原文

arXiv 摘要页 · PDF 原文 · HTML 原文

↑