arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1904.08375cs.IRcs.LG
收藏

通过查询预测进行文档扩展

Document Expansion by Query Prediction

Tandon School of Engineering, New York University(纽约大学坦登工程学院);David R. Cheriton School of Computer Science, University of Waterloo(滑铁卢大学戴维·R·切里顿计算机科学学院);Courant Institute of Mathematical Sciences, New York University(纽约大学库朗数学科学研究所);Center for Data Science, New York University(纽约大学数据科学中心);Facebook AI Research(脸书人工智能研究院)

Rodrigo Nogueira, Wei Yang, Jimmy Lin, Kyunghyun Cho

摘要:

一种提高搜索引擎检索效率的技术是用与文档内容相关或代表文档内容的术语来扩展文档。从问答系统的角度来看,这可能包括文档可能回答的问题。根据这一观察结果,我们提出了一种简单的方法,该方法预测将针对给定文档发出哪些查询,然后使用由查询和相关文档对组成的数据集进行训练的香草序列到序列模型来扩展这些预测。通过将我们的方法与高效的重新排序组件相结合,我们在两个检索任务中实现了最先进的技术。在延迟临界状态下,单独的检索结果(没有重新排序)接近计算成本更高的神经重新排序器的有效性,但要快得多。

英文摘要:

One technique to improve the retrieval effectiveness of a search engine is to expand documents with terms that are related or representative of the documents' content.From the perspective of a question answering system, this might comprise questions the document can potentially answer. Following this observation, we propose a simple method that predicts which queries will be issued for a given document and then expands it with those predictions with a vanilla sequence-to-sequence model, trained using datasets consisting of pairs of query and relevant documents. By combining our method with a highly-effective re-ranking component, we achieve the state of the art in two retrieval tasks. In a latency-critical regime, retrieval results alone (without re-ranking) approach the effectiveness of more computationally expensive neural re-rankers but are much faster.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑