arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2202.10668cs.CLcs.IR
收藏

关系分类中反事实的自动生成

Automatically Generating Counterfactuals for Relation Classification

Wuhan University(武汉大学)

Mi Zhang, Tieyun Qian, Ting Zhang

摘要:

关系分类的目标是提取文本中实体之间的语义关系。作为自然语言处理的一项基本任务,保证RC模型的鲁棒性至关重要。尽管当前深度神经模型在RC任务中实现了高精度,但它们很容易受到虚假相关的影响。这个问题的一个解决方案是用反事实增强数据(CAD)训练模型,使得它可以学习因果关系而不是混淆。然而,没有尝试产生反事实的RC任务。在本文中,我们制定了自动生成CAD的RC任务从实体为中心的观点的问题,并开发了一种新的方法来获得上下文的实体反事实。具体来说,我们利用两个基本的拓扑性质,即,句法和语义依赖图中的中心性和最短路径,以首先识别并然后干预实体的上下文因果特征。我们进行了全面的评估四个RC数据集结合我们提出的方法与各种骨干RC模型。实验结果表明,该方法不仅提高了骨干网的性能,而且使其在域外测试中更加健壮。

英文摘要:

The goal of relation classification (RC) is to extract the semantic relations between/among entities in the text. As a fundamental task in natural language processing, it is crucial to ensure the robustness of RC models. Despite the high accuracy current deep neural models have achieved in RC tasks, they are easily affected by spurious correlations. One solution to this problem is to train the model with counterfactually augmented data (CAD) such that it can learn the causation rather than the confounding. However, no attempt has been made on generating counterfactuals for RC tasks. In this paper, we formulate the problem of automatically generating CAD for RC tasks from an entity-centric viewpoint, and develop a novel approach to derive contextual counterfactuals for entities. Specifically, we exploit two elementary topological properties, i.e., the centrality and the shortest path, in syntactic and semantic dependency graphs, to first identify and then intervene on the contextual causal features for entities. We conduct a comprehensive evaluation on four RC datasets by combining our proposed approach with a variety of backbone RC models. The results demonstrate that our approach not only improves the performance of the backbones, but also makes them more robust in the out-of-domain test.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑