arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2001.03272cs.IRcs.LG
收藏

使用Web表格的开放域问答

Open Domain Question Answering Using Web Tables

Microsoft Research(微软研究院);Microsoft (Bing)(微软(必应))

Kaushik Chakrabarti, Zhimin Chen, Siamak Shakeri, Guihong Cao

摘要:

从Web文档中提取的表可以用于直接回答许多Web搜索查询。先前关于使用web表格的问答(QA)的工作集中于事实式查询,即,那些可以用一个短字符串回答的,比如人名或数字。然而,许多使用表可回答的查询本质上是非事实的。在本文中,我们开发了一个开放域的QA方法,使用Web表格,适用于factoid和非factoid查询。我们的关键见解是将查询和表之间基于深度神经网络的语义相似性与量化表在文档中的主导地位以及表中信息质量的特征相结合。我们对现实生活中的网络搜索查询的实验表明,我们的方法显着优于国家的最先进的基线方法。我们的解决方案已在一家大型商业网络搜索引擎的生产环境中使用,并为每月数千万次真实用户查询提供直接答案。

英文摘要:

Tables extracted from web documents can be used to directly answer many web search queries. Previous works on question answering (QA) using web tables have focused on factoid queries, i.e., those answerable with a short string like person name or a number. However, many queries answerable using tables are non-factoid in nature. In this paper, we develop an open-domain QA approach using web tables that works for both factoid and non-factoid queries. Our key insight is to combine deep neural network-based semantic similarity between the query and the table with features that quantify the dominance of the table in the document as well as the quality of the information in the table. Our experiments on real-life web search queries show that our approach significantly outperforms state-of-the-art baseline approaches. Our solution is used in production in a major commercial web search engine and serves direct answers for tens of millions of real user queries per month.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑