arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1901.10197cs.IR
收藏

一种基于Wikipedia和WordNet的查询扩展方法

A new approach for query expansion using Wikipedia and WordNet

Hiteshwar Kumar Azad, Akshay Deepak

摘要:

查询扩展(QE)是用于增强信息检索的有效性的公知技术。QE通过添加有助于检索更相关结果的类似术语来重新制定初始查询。在文献中已经提出了几种方法,产生了相当有利的结果,但它们并不均匀地有利于所有类型的查询(个人和短语查询)。其中一个主要原因是使用相同类型的数据源和加权方案,同时扩展单个和短语查询项。结果,查询项之间的整体关系没有被很好地捕获或评分。为了解决这个问题,我们提出了一种新的量化宽松方法,使用维基百科和WordNet作为数据源。具体来说,Wikipedia为短语术语提供了丰富的扩展术语,而WordNet为单个术语提供了相同的扩展术语。我们还提出了新的加权方案的扩展条款:在链接得分(从维基百科中提取的条款)和一个TF-IDF为基础的计划(从WordNet中提取的条款)。在建议的Wikipedia-WordNet-based QE技术(WWQE)中,我们对扩展项进行两次加权:首先,它们分别由加权方案进行评分,然后,加权方案使用相关性得分对所选扩展项进行评分。所提出的方法获得了24%的MAP分数和48%的GMAP分数上的改进,在未扩展的查询上的FIRE数据集。实验结果实现了显着的改善,个人的扩展和其他相关的国家的最先进的方法。我们还分析了通过改变扩展项的数量对所提出的技术的检索效果的影响。

英文摘要:

Query expansion (QE) is a well-known technique used to enhance the effectiveness of information retrieval. QE reformulates the initial query by adding similar terms that help in retrieving more relevant results. Several approaches have been proposed in literature producing quite favorable results, but they are not evenly favorable for all types of queries (individual and phrase queries). One of the main reasons for this is the use of the same kind of data sources and weighting scheme while expanding both the individual and the phrase query terms. As a result, the holistic relationship among the query terms is not well captured or scored. To address this issue, we have presented a new approach for QE using Wikipedia and WordNet as data sources. Specifically, Wikipedia gives rich expansion terms for phrase terms, while WordNet does the same for individual terms. We have also proposed novel weighting schemes for expansion terms: in-link score (for terms extracted from Wikipedia) and a tf-idf based scheme (for terms extracted from WordNet). In the proposed Wikipedia-WordNet-based QE technique (WWQE), we weigh the expansion terms twice: first, they are scored by the weighting scheme individually, and then, the weighting scheme scores the selected expansion terms concerning the entire query using correlation score. The proposed approach gains improvements of 24% on the MAP score and 48% on the GMAP score over unexpanded queries on the FIRE dataset. Experimental results achieve a significant improvement over individual expansion and other related state-of-the-art approaches. We also analyzed the effect on retrieval effectiveness of the proposed technique by varying the number of expansion terms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑