Reasoning is a crucial part of natural language argumentation. To comprehend an argument, one must analyze its warrant, which explains why its claim follows from its premises. As arguments are highly contextualized, warrants are usually presupposed and left implicit. Thus, the comprehension does not only require language understanding and logic skills, but also depends on common sense. In this paper we develop a methodology for reconstructing warrants systematically. We operationalize it in a scalable crowdsourcing process, resulting in a freely licensed dataset with warrants for 2k authentic arguments from news comments. On this basis, we present a new challenging task, the argument reasoning comprehension task. Given an argument with a claim and a premise, the goal is to choose the correct implicit warrant from two options. Both warrants are plausible and lexically close, but lead to contradicting claims. A solution to this task will define a substantial step towards automatic warrant reconstruction. However, experiments with several neural attention and language models reveal that current approaches do not suffice.
Mastering Symbolic Operations: Augmenting Language Models with Compiled Neural Networks
The Laboratory of Cognition and Decision Intelligence for Complex Systems, IA, CAS(中国科学院自动化研究所复杂系统认知与决策智能实验室);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);College of Electrical and Information Engineering, Hunan University(湖南大学电气与信息工程学院)
Explicit vs. Implicit Biographies: Evaluating and Adapting LLM Information Extraction on Wikidata-Derived Texts
DISI Departement of Computer Science and Engineering, University of Bologna(博洛尼亚大学计算机科学与工程系);Automobili Lamborghini SpA(法拉利公司);Digital Humanities Advanced Research Center(数字人文高级研究中心);KNAW Humanities Cluster, DHLab(KNAW 人文集群,DHLab);ETH Zurich, Collegium Helveticum(苏黎世联邦理工学院,瑞士学院)
Microsoft Research India(微软研究院印度分部);LinkedIn(领英公司);Nutanix(Nutanix公司);Indian Institute of Science(印度科学学院);Apple(苹果公司);Fujitsu Research India(富士通印度研究院);Indian Institute of Technology Kharagpur(印度克勒格布尔印度理工学院)