e-QRAQ:一个多轮推理数据集和模拟器
e-QRAQ: A Multi-turn Reasoning Dataset and Simulator with Explanations
摘要:
在本文中,我们提出了一个新的数据集和用户模拟器e-QRAQ(可解释的查询,原因和回答问题),它测试代理的能力,阅读一个模棱两可的文本,问问题,直到它可以回答一个挑战性的问题,并解释其问题和答案背后的推理。用户模拟器为Agent提供了一个简短、模糊的故事和一个关于故事的挑战问题。这个故事是模棱两可的,因为一些实体已经被变量所取代。在每个回合中,Agent可能会询问变量的值或尝试回答挑战问题。作为响应,用户模拟器提供自然语言解释为什么代理的查询或回答在缩小可能答案的集合方面是有用的。为了演示e-QRAQ数据集的一个潜在应用,我们训练了一个基于端到端记忆网络的新神经架构,以成功生成对其当前对问题的理解的预测和部分解释。我们观察到预测和解释的质量之间有很强的相关性。
英文摘要:
In this paper we present a new dataset and user simulator e-QRAQ (explainable Query, Reason, and Answer Question) which tests an Agent's ability to read an ambiguous text; ask questions until it can answer a challenge question; and explain the reasoning behind its questions and answer. The User simulator provides the Agent with a short, ambiguous story and a challenge question about the story. The story is ambiguous because some of the entities have been replaced by variables. At each turn the Agent may ask for the value of a variable or try to answer the challenge question. In response the User simulator provides a natural language explanation of why the Agent's query or answer was useful in narrowing down the set of possible answers, or not. To demonstrate one potential application of the e-QRAQ dataset, we train a new neural architecture based on End-to-End Memory Networks to successfully generate both predictions and partial explanations of its current understanding of the problem. We observe a strong correlation between the quality of the prediction and explanation.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。