arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1606.07608cs.IR
收藏

使用词嵌入实现自动查询扩展

Using Word Embeddings for Automatic Query Expansion

Dwaipayan Roy, Debjyoti Paul, Mandar Mitra, Utpal Garain

摘要:

本文提出了一种基于分布式神经语言模型word 2 vec的自动查询扩展(AQE)框架。word 2 vec在分布式无监督框架中使用语义和上下文关系,为每个词汇条目学习低维嵌入。利用这个框架,我们设计了一个查询扩展技术,其中相关的条款,以一个查询的K-最近邻方法。我们探讨的AQE方法的性能,有和没有反馈查询扩展,和一个简单的K-最近邻的变种,在建议的框架。在标准TREC ad-hoc数据(具有查询集301-450、601-700的盘4、5)和web数据(具有查询集451-550的WT 10 G数据)上的实验示出了比基于标准术语重叠的检索方法的显著改进。然而,所提出的方法无法实现与基于统计共现的反馈方法(如RM 3)相当的性能。我们还发现,基于word 2 vec的查询扩展方法在有和没有任何反馈信息的情况下执行类似。

英文摘要:

In this paper a framework for Automatic Query Expansion (AQE) is proposed using distributed neural language model word2vec. Using semantic and contextual relation in a distributed and unsupervised framework, word2vec learns a low dimensional embedding for each vocabulary entry. Using such a framework, we devise a query expansion technique, where related terms to a query are obtained by K-nearest neighbor approach. We explore the performance of the AQE methods, with and without feedback query expansion, and a variant of simple K-nearest neighbor in the proposed framework. Experiments on standard TREC ad-hoc data (Disk 4, 5 with query sets 301-450, 601-700) and web data (WT10G data with query set 451-550) shows significant improvement over standard term-overlapping based retrieval methods. However the proposed method fails to achieve comparable performance with statistical co-occurrence based feedback method such as RM3. We have also found that the word2vec based query expansion methods perform similarly with and without any feedback information.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑