arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1907.04780cs.CL
收藏

ReQA:端到端答案检索模型的评价

ReQA: An Evaluation for End-to-End Answer Retrieval Models

Google Research(谷歌研究院)

Amin Ahmad, Noah Constant, Yinfei Yang, Daniel Cer

摘要:

像SQuAD这样的流行QA基准已经推动了在特定段落中识别答案跨度的任务的进展,模型现在已经超过了人类的表现。然而,从一个巨大的文档语料库中检索相关的答案仍然是一个具有挑战性的问题,并对模型架构提出了不同的要求。人们越来越有兴趣开发可扩展的端到端训练的答案检索模型,绕过典型的文档检索步骤。在本文中,我们介绍了检索查询(ReQA),用于评估大规模的答案级检索模型的基准。我们使用神经编码模型以及经典的信息检索技术建立基线。我们发布我们的评估代码,以鼓励进一步的工作,这一具有挑战性的任务。

英文摘要:

Popular QA benchmarks like SQuAD have driven progress on the task of identifying answer spans within a specific passage, with models now surpassing human performance. However, retrieving relevant answers from a huge corpus of documents is still a challenging problem, and places different requirements on the model architecture. There is growing interest in developing scalable answer retrieval models trained end-to-end, bypassing the typical document retrieval step. In this paper, we introduce Retrieval Question-Answering (ReQA), a benchmark for evaluating large-scale sentence-level answer retrieval models. We establish baselines using both neural encoding models as well as classical information retrieval techniques. We release our evaluation code to encourage further work on this challenging task.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑