基于外部因果陈述的自我监督表示学习改进事件因果关系识别
Improving Event Causality Identification via Self-Supervised Representation Learning on External Causal Statement
摘要:
目前的事件因果关系识别模型主要采用有监督的框架,严重依赖于标记数据进行训练。不幸的是,目前的注释数据集的规模相对有限,这不能为模型提供足够的支持,以从因果陈述中捕获有用的指标,特别是处理那些新的,看不见的情况。为了缓解这个问题,我们提出了一种新的方法,简称为CauSeRL,它利用外部因果关系的事件因果关系的识别。首先,我们设计了一个自我监督的框架,从外部因果陈述中学习特定于上下文的因果模式。然后,我们采用对比迁移策略,将学习到的特定于上下文的因果模式到目标ECI模型。实验结果表明,我们的方法显着优于以前的方法EventStoryLine和Cause-TimeBank(+2.0和+3.4点的F1值分别)。
英文摘要:
Current models for event causality identification (ECI) mainly adopt a supervised framework, which heavily rely on labeled data for training. Unfortunately, the scale of current annotated datasets is relatively limited, which cannot provide sufficient support for models to capture useful indicators from causal statements, especially for handing those new, unseen cases. To alleviate this problem, we propose a novel approach, shortly named CauSeRL, which leverages external causal statements for event causality identification. First of all, we design a self-supervised framework to learn context-specific causal patterns from external causal statements. Then, we adopt a contrastive transfer strategy to incorporate the learned context-specific causal patterns into the target ECI model. Experimental results show that our method significantly outperforms previous methods on EventStoryLine and Causal-TimeBank (+2.0 and +3.4 points on F1 value respectively).
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。