arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2408.03079cs.CLcs.AI
收藏

通过改进的子任务交互与知识融合增强复杂因果关系抽取

Enhancing Complex Causality Extraction via Improved Subtask Interaction and Knowledge Fusion

Harbin Institute of Technology(哈尔滨工业大学);Huawei Cloud(华为云)

Jinglong Gao, Chen Lu, Xiao Ding, Zhongyang Li, Ting Liu, Bing Qin

AI总结:

本文提出统一框架UniCE,通过子任务交互机制、双模态知识融合机制和独立解码器同时解决复杂因果关系抽取、子任务交互与知识融合三大挑战,在三个基准上超越ChatGPT至少30% F1,并可通过上下文学习提升ChatGPT性能。

摘要:

事件因果关系抽取(ECE)旨在从文本中抽取因果事件对。尽管ChatGPT近期取得了成功,但对小型模型进行微调仍然是ECE任务的最佳方法。然而,现有的基于微调的ECE方法无法同时解决ECE中的三个关键挑战:1)复杂因果关系抽取,即单个句子中出现多个因果事件对;2)子任务交互,即建模ECE两个子任务之间的相互依赖关系,即抽取事件与识别所抽取事件之间的因果关系;3)知识融合,即需要有效融合两种模态中的知识,即具有表达能力的预训练语言模型和结构化知识图谱。在本文中,我们提出了一个统一的ECE框架(UniCE),以同时解决ECE中的这三个问题。具体而言,我们设计了一个子任务交互机制,使两个ECE子任务之间能够相互交互。此外,我们设计了一个知识融合机制,以融合两种模态中的知识。进一步地,我们为每个子任务采用独立的解码器,以促进复杂因果关系抽取。在三个基准数据集上的实验表明,我们的方法取得了最先进的性能,并以至少30%的F1分数优势超越了ChatGPT。更重要的是,我们的模型还可以通过上下文学习有效提升ChatGPT的ECE性能。

英文摘要:

Event Causality Extraction (ECE) aims at extracting causal event pairs from texts. Despite ChatGPT's recent success, fine-tuning small models remains the best approach for the ECE task. However, existing fine-tuning based ECE methods cannot address all three key challenges in ECE simultaneously: 1) Complex Causality Extraction, where multiple causal-effect pairs occur within a single sentence; 2) Subtask~ Interaction, which involves modeling the mutual dependence between the two subtasks of ECE, i.e., extracting events and identifying the causal relationship between extracted events; and 3) Knowledge Fusion, which requires effectively fusing the knowledge in two modalities, i.e., the expressive pretrained language models and the structured knowledge graphs. In this paper, we propose a unified ECE framework (UniCE to address all three issues in ECE simultaneously. Specifically, we design a subtask interaction mechanism to enable mutual interaction between the two ECE subtasks. Besides, we design a knowledge fusion mechanism to fuse knowledge in the two modalities. Furthermore, we employ separate decoders for each subtask to facilitate complex causality extraction. Experiments on three benchmark datasets demonstrate that our method achieves state-of-the-art performance and outperforms ChatGPT with a margin of at least 30% F1-score. More importantly, our model can also be used to effectively improve the ECE performance of ChatGPT via in-context learning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑