arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2012.09650cs.IR
收藏

ColBERT的白盒分析

A White Box Analysis of ColBERT

Thibault Formal, Benjamin Piwowarski, Stéphane Clinchant

摘要:

基于transformer的模型是目前ad-hoc信息检索中最先进的模型,但其行为还远未被理解。最近的工作声称,BERT不满足经典IR公理。然而,我们建议通过分析术语重要性和精确/软匹配模式来剖析ColBERT的匹配过程。即使传统的公理没有得到正式验证,我们的分析表明,ColBERT:(i)能够捕获术语重要性的概念;(ii)依赖于重要术语的精确匹配。

英文摘要:

Transformer-based models are nowadays state-of-the-art in ad-hoc Information Retrieval, but their behavior is far from being understood. Recent work has claimed that BERT does not satisfy the classical IR axioms. However, we propose to dissect the matching process of ColBERT, through the analysis of term importance and exact/soft matching patterns. Even if the traditional axioms are not formally verified, our analysis reveals that ColBERT: (i) is able to capture a notion of term importance; (ii) relies on exact matches for important terms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑