arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1303.0667cs.IR
收藏

利用术语分布和术语关联的查询扩展

Query Expansion Using Term Distribution and Term Association

Dipasree Pal, Mandar Mitra, Kalyankumar Datta

摘要:

好的术语选择是自动查询扩展(AQE)技术的一个重要问题。从目标语料库中选择扩展术语的AQE技术通常以两种方式之一这样做。基于分布的术语选择将术语在(伪)相关文档中的分布与在整个语料库/随机分布中的分布进行比较。两种著名的基于分布的方法是基于Kullback-Leibler散度(KLD)和Bose-Einstein统计(Bo 1)。另一方面,基于关联的术语选择使用关于候选术语如何与原始查询术语共现的信息。局部上下文分析(LCA)和基于关联的语言模型(RM 3)是基于关联的方法的示例。我们在这项研究中的目标是研究如何将这两类方法结合起来,以提高检索效率。我们提出了以下基于组合的方法。首先使用基于分布的方法获得候选扩展项。然后,基于术语与原始查询术语的关联强度来细化该集合。我们在11个TREC集合上测试我们的方法。所提出的组合通常比每个单独的方法以及其他最先进的AQE方法产生更好的结果。在我们的主要目标的途中,我们还提出了一些修改LCA和Bo 1,从而提高性能。

英文摘要:

Good term selection is an important issue for an automatic query expansion (AQE) technique. AQE techniques that select expansion terms from the target corpus usually do so in one of two ways. Distribution based term selection compares the distribution of a term in the (pseudo) relevant documents with that in the whole corpus / random distribution. Two well-known distribution-based methods are based on Kullback-Leibler Divergence (KLD) and Bose-Einstein statistics (Bo1). Association based term selection, on the other hand, uses information about how a candidate term co-occurs with the original query terms. Local Context Analysis (LCA) and Relevance-based Language Model (RM3) are examples of association-based methods. Our goal in this study is to investigate how these two classes of methods may be combined to improve retrieval effectiveness. We propose the following combination-based approach. Candidate expansion terms are first obtained using a distribution based method. This set is then refined based on the strength of the association of terms with the original query terms. We test our methods on 11 TREC collections. The proposed combinations generally yield better results than each individual method, as well as other state-of-the-art AQE approaches. En route to our primary goal, we also propose some modifications to LCA and Bo1 which lead to improved performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑