arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2106.01654cs.CL
收藏

基于外部因果陈述的自我监督表示学习改进事件因果关系识别

Improving Event Causality Identification via Self-Supervised Representation Learning on External Causal Statement

Institute of Automation, CAS(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);Beijing Baidu Netcom Science Technology Co., Ltd(北京百度网讯科技有限公司)

Xinyu Zuo, Pengfei Cao, Yubo Chen, Kang Liu, Jun Zhao, Weihua Peng, Yuguang Chen

摘要:

目前的事件因果关系识别模型主要采用有监督的框架,严重依赖于标记数据进行训练。不幸的是,目前的注释数据集的规模相对有限,这不能为模型提供足够的支持,以从因果陈述中捕获有用的指标,特别是处理那些新的,看不见的情况。为了缓解这个问题,我们提出了一种新的方法,简称为CauSeRL,它利用外部因果关系的事件因果关系的识别。首先,我们设计了一个自我监督的框架,从外部因果陈述中学习特定于上下文的因果模式。然后,我们采用对比迁移策略,将学习到的特定于上下文的因果模式到目标ECI模型。实验结果表明,我们的方法显着优于以前的方法EventStoryLine和Cause-TimeBank(+2.0和+3.4点的F1值分别)。

英文摘要:

Current models for event causality identification (ECI) mainly adopt a supervised framework, which heavily rely on labeled data for training. Unfortunately, the scale of current annotated datasets is relatively limited, which cannot provide sufficient support for models to capture useful indicators from causal statements, especially for handing those new, unseen cases. To alleviate this problem, we propose a novel approach, shortly named CauSeRL, which leverages external causal statements for event causality identification. First of all, we design a self-supervised framework to learn context-specific causal patterns from external causal statements. Then, we adopt a contrastive transfer strategy to incorporate the learned context-specific causal patterns into the target ECI model. Experimental results show that our method significantly outperforms previous methods on EventStoryLine and Causal-TimeBank (+2.0 and +3.4 points on F1 value respectively).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑