arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2010.09366cs.CLcs.AI
收藏

理解不自然的问题可以提高文本推理能力

Understanding Unnatural Questions Improves Reasoning over Text

Monash University(莫纳什大学)

Xiao-Yu Guo, Yuan-Fang Li, Gholamreza Haffari

摘要:

基于原始文本的复杂问答(CQA)是一项具有挑战性的任务。这个任务的一个突出的方法是基于程序员-解释器框架,程序员将问题映射到一系列推理动作中,然后由解释器在原始文本上执行。学习一个有效的CQA模型需要大量的人工注释数据,包括推理动作的地面实况序列,这是耗时和昂贵的大规模收集。在本文中,我们通过将自然的人类生成的问题投影到更方便解析的非自然机器生成的问题来解决学习高质量程序员(解析器)的挑战。我们首先生成合成(问题,动作序列)对的数据发生器,和训练的语义分析器,将合成的问题与其相应的动作序列。为了捕捉应用于自然问题时的多样性,我们学习了一个投影模型,将自然问题映射到最相似的非自然问题,解析器可以很好地工作。在没有任何自然训练数据的情况下,我们的投影模型为CQA任务提供了高质量的动作序列。实验结果表明,专门用我们的方法生成的合成数据训练的QA模型优于用人工标记数据训练的最先进的QA模型。

英文摘要:

Complex question answering (CQA) over raw text is a challenging task. A prominent approach to this task is based on the programmer-interpreter framework, where the programmer maps the question into a sequence of reasoning actions which is then executed on the raw text by the interpreter. Learning an effective CQA model requires large amounts of human-annotated data,consisting of the ground-truth sequence of reasoning actions, which is time-consuming and expensive to collect at scale. In this paper, we address the challenge of learning a high-quality programmer (parser) by projecting natural human-generated questions into unnatural machine-generated questions which are more convenient to parse. We firstly generate synthetic (question,action sequence) pairs by a data generator, and train a semantic parser that associates synthetic questions with their corresponding action sequences. To capture the diversity when applied tonatural questions, we learn a projection model to map natural questions into their most similar unnatural questions for which the parser can work well. Without any natural training data, our projection model provides high-quality action sequences for the CQA task. Experimental results show that the QA model trained exclusively with synthetic data generated by our method outperforms its state-of-the-art counterpart trained on human-labeled data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑