arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1606.01404cs.CLcs.AIcs.NE
收藏

生成自然语言推理链

Generating Natural Language Inference Chains

University College London(伦敦大学学院)

Vladyslav Kolesnyk, Tim Rocktäschel, Sebastian Riedel

摘要:

使用自然语言进行推理的能力是许多NLP任务的基本先决条件,例如信息抽取、机器翻译和问答。为了量化这种能力,通常测试系统是否可以识别文本蕴涵,即,一个句子是否可以从另一个句子推断出来。然而,在大多数NLP应用程序中,只有单个源句子,而不是句子对。因此,我们提出了一个新的任务,衡量一个模型可以从源句子生成一个蕴涵句子。我们采用斯坦福自然语言推理语料库的蕴涵对,并训练LSTM。在手动注释的测试集中,我们发现82%生成的句子是正确的,比LSTM基线提高了10.3%。定性分析表明,该模型不仅能够缩短输入句子,而且能够通过释义和短语蕴涵来推断新的语句。然后,我们递归地将该模型应用于输入输出对,从而生成自然语言推理链,该推理链可用于从源句子自动构建蕴涵图。最后,通过交换源句子和目标句子,我们还可以训练一个模型,该模型在给定输入句子的情况下发明附加信息来生成新句子。

英文摘要:

The ability to reason with natural language is a fundamental prerequisite for many NLP tasks such as information extraction, machine translation and question answering. To quantify this ability, systems are commonly tested whether they can recognize textual entailment, i.e., whether one sentence can be inferred from another one. However, in most NLP applications only single source sentences instead of sentence pairs are available. Hence, we propose a new task that measures how well a model can generate an entailed sentence from a source sentence. We take entailment-pairs of the Stanford Natural Language Inference corpus and train an LSTM with attention. On a manually annotated test set we found that 82% of generated sentences are correct, an improvement of 10.3% over an LSTM baseline. A qualitative analysis shows that this model is not only capable of shortening input sentences, but also inferring new statements via paraphrasing and phrase entailment. We then apply this model recursively to input-output pairs, thereby generating natural language inference chains that can be used to automatically construct an entailment graph from source sentences. Finally, by swapping source and target sentences we can also train a model that given an input sentence invents additional information to generate a new sentence.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑