arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2212.06121cs.IRcs.CL
收藏

为零镜头检索的交叉编码器辩护

In Defense of Cross-Encoders for Zero-Shot Retrieval

NeuralMind;UNICAMP(坎皮纳斯大学);Zeta Alpha

Guilherme Rosa, Luiz Bonifacio, Vitor Jeronymo, Hugo Abonizio, Marzieh Fadaee, Roberto Lotufo, Rodrigo Nogueira

摘要:

双编码器和交叉编码器广泛用于许多最先进的检索管道中。在这项工作中,我们研究的泛化能力,这两种类型的架构上的一个广泛的参数计数域内和域外的情况。我们发现,参数的数量和交叉编码器的早期查询文档的相互作用在检索模型的泛化能力发挥了重要作用。我们的实验表明,增加模型大小的结果在域内测试集的边际收益,但更大的收益在新的领域从未见过在微调。此外,我们表明,交叉编码器在很大程度上优于类似大小的双编码器在几个任务。在BEIR基准测试中,我们最大的交叉编码器超过最先进的双向编码器超过4个平均点。最后,我们表明,使用双编码器作为第一阶段检索器相比,一个更简单的检索器,如BM 25的域外任务,没有提供任何收益。代码可在www.example.com上获得

英文摘要:

Bi-encoders and cross-encoders are widely used in many state-of-the-art retrieval pipelines. In this work we study the generalization ability of these two types of architectures on a wide range of parameter count on both in-domain and out-of-domain scenarios. We find that the number of parameters and early query-document interactions of cross-encoders play a significant role in the generalization ability of retrieval models. Our experiments show that increasing model size results in marginal gains on in-domain test sets, but much larger gains in new domains never seen during fine-tuning. Furthermore, we show that cross-encoders largely outperform bi-encoders of similar size in several tasks. In the BEIR benchmark, our largest cross-encoder surpasses a state-of-the-art bi-encoder by more than 4 average points. Finally, we show that using bi-encoders as first-stage retrievers provides no gains in comparison to a simpler retriever such as BM25 on out-of-domain tasks. The code is available at https://github.com/guilhermemr04/scaling-zero-shot-retrieval.git

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑