arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2010.01713cs.CLcs.AIcs.LG
收藏

阅读理解作为自然语言推理的语义分析

Reading Comprehension as Natural Language Inference: A Semantic Analysis

College of Information and Computer Sciences, University of Massachusetts Amherst(马萨诸塞大学阿默斯特分校信息与计算机科学学院);IBM Research(IBM研究(中心))

Anshuman Mishra, Dhruvesh Patel, Aparna Vijayakumar, Xiang Li, Pavan Kapanipathi, Kartik Talamadupula

摘要:

最近,自然语言推理(NLI)得到了极大的关注,特别是考虑到它对下游NLP任务的承诺。然而,其真正的影响是有限的,并没有得到很好的研究。因此,在本文中,我们探讨的效用NLI的最突出的下游任务之一,即。问答(QA)。我们将最大的可用MRC数据集(RACE)转换为NLI形式,并比较了最先进的模型(RoberTa)在这两种形式上的性能。我们提出了新的问题的特征,并评估这些类别的QA和NLI模型的性能。我们突出了明确的类别,模型能够更好地执行时,数据是在一个连贯的蕴涵形式,和结构化的问答连接形式,分别。

英文摘要:

In the recent past, Natural language Inference (NLI) has gained significant attention, particularly given its promise for downstream NLP tasks. However, its true impact is limited and has not been well studied. Therefore, in this paper, we explore the utility of NLI for one of the most prominent downstream tasks, viz. Question Answering (QA). We transform the one of the largest available MRC dataset (RACE) to an NLI form, and compare the performances of a state-of-the-art model (RoBERTa) on both these forms. We propose new characterizations of questions, and evaluate the performance of QA and NLI models on these categories. We highlight clear categories for which the model is able to perform better when the data is presented in a coherent entailment form, and a structured question-answer concatenation form, respectively.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑