FecTek:利用特征上下文和词项级知识增强基于词项的检索中的词项权重
FecTek: Enhancing Term Weight in Lexicon-Based Retrieval with Feature Context and Term-level Knowledge
AI总结:
本文提出FecTek方法,通过特征上下文模块和词项级知识指导模块增强基于词项的检索中的词项权重,在MS Marco基准上超越现有最先进方法。
摘要:
基于词项的检索因其高效且稳健的性能在文本检索领域获得了广泛关注。为进一步提升基于词项的检索性能,研究人员一直在努力整合最先进的方法,如神经检索和文本级对比学习方法。然而,尽管取得了令人鼓舞的成果,当前基于词项的检索方法在探索特征上下文表示和词项级知识指导的潜在优势方面所受到的关注有限。在本文中,我们通过引入特征上下文和词项级知识模块(FecTek)提出了一种创新方法。为有效丰富词项权重的特征上下文表示,我们引入了特征上下文模块(FCM),该模块利用BERT表示的能力来确定嵌入中每个元素的动态权重。此外,我们开发了一个词项级知识指导模块(TKGM),以有效利用词项级知识来智能地指导词项权重的建模过程。在MS Marco基准上的评估表明,该方法优于先前的最先进方法。
英文摘要:
Lexicon-based retrieval has gained siginificant popularity in text retrieval due to its efficient and robust performance. To further enhance performance of lexicon-based retrieval, researchers have been diligently incorporating state-of-the-art methodologies like Neural retrieval and text-level contrastive learning approaches. Nonetheless, despite the promising outcomes, current lexicon-based retrieval methods have received limited attention in exploring the potential benefits of feature context representations and term-level knowledge guidance. In this paper, we introduce an innovative method by introducing FEature Context and TErm-level Knowledge modules(FecTek). To effectively enrich the feature context representations of term weight, the Feature Context Module (FCM) is introduced, which leverages the power of BERT's representation to determine dynamic weights for each element in the embedding. Additionally, we develop a term-level knowledge guidance module (TKGM) for effectively utilizing term-level knowledge to intelligently guide the modeling process of term weight. Evaluation of the proposed method on MS Marco benchmark demonstrates its superiority over the previous state-of-the-art approaches.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。