arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2202.13352cs.CLcs.AI

HiCLRE: A Hierarchical Contrastive Learning Framework for Distantly Supervised Relation Extraction

East China Normal University(华东师范大学);Alibaba Group(阿里巴巴集团);Shanghai Research Institute for Intelligent Autonomous Systems(上海智能自主系统研究院)

Dongyang Li, Taolin Zhang, Nan Hu, Chengyu Wang, Xiaofeng He

英文摘要:

Distant supervision assumes that any sentence containing the same entity pairs reflects identical relationships. Previous works of distantly supervised relation extraction (DSRE) task generally focus on sentence-level or bag-level de-noising techniques independently, neglecting the explicit interaction with cross levels. In this paper, we propose a hierarchical contrastive learning Framework for Distantly Supervised relation extraction (HiCLRE) to reduce noisy sentences, which integrate the global structural information and local fine-grained interaction. Specifically, we propose a three-level hierarchical learning framework to interact with cross levels, generating the de-noising context-aware representations via adapting the existing multi-head self-attention, named Multi-Granularity Recontextualization. Meanwhile, pseudo positive samples are also provided in the specific level for contrastive learning via a dynamic gradient-based data augmentation strategy, named Dynamic Gradient Adversarial Perturbation. Experiments demonstrate that HiCLRE significantly outperforms strong baselines in various mainstream DSRE datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑