arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1808.09353cs.CLcs.IR
收藏

Xu:一个自动化的查询扩展和优化工具

Xu: An Automated Query Expansion and Optimization Tool

Queen’s University(女王大学);Gnowit Inc.(Gnowit公司)

Morgan Gallant, Haruna Isah, Farhana Zulkernine, Shahzad Khan

摘要:

互联网上信息的指数增长对信息检索系统产生相关结果是一个巨大的挑战。需要新的方法来重新格式化或扩展用户查询,以生成令人满意的响应,并提高召回率和精度。查询扩展(QE)是一种基于语义相似性度量引入附加标记或短语来扩展用户查询的技术。折衷的是增加的计算复杂性,以找到语义相似的单词和可能增加的噪音在信息检索。尽管在这个问题上的一些研究工作,量化宽松尚未被探索不够,需要更多的工作,在相似性匹配和组合查询条件的目标是检索一个小的最适当的反应。QE在处理复杂查询时应该是可伸缩的、快速的和健壮的,并且具有良好的响应时间和噪声上限。在本文中,我们提出了徐,一个自动QE技术,使用高维聚类的词向量和Datamuse API,一个开源的查询引擎,找到语义相似的话。我们将Xu实现为命令行工具,并使用包含新闻文章和人工生成QE的数据集评估其性能。评估结果表明,Xu优于Datamuse,参考人类生成的QE,准确率约为88%。

英文摘要:

The exponential growth of information on the Internet is a big challenge for information retrieval systems towards generating relevant results. Novel approaches are required to reformat or expand user queries to generate a satisfactory response and increase recall and precision. Query expansion (QE) is a technique to broaden users' queries by introducing additional tokens or phrases based on some semantic similarity metrics. The tradeoff is the added computational complexity to find semantically similar words and a possible increase in noise in information retrieval. Despite several research efforts on this topic, QE has not yet been explored enough and more work is needed on similarity matching and composition of query terms with an objective to retrieve a small set of most appropriate responses. QE should be scalable, fast, and robust in handling complex queries with a good response time and noise ceiling. In this paper, we propose Xu, an automated QE technique, using high dimensional clustering of word vectors and Datamuse API, an open source query engine to find semantically similar words. We implemented Xu as a command line tool and evaluated its performances using datasets containing news articles and human-generated QEs. The evaluation results show that Xu was better than Datamuse by achieving about 88% accuracy with reference to the human-generated QE.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑