arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2007.15084cs.IR
收藏

基于层次对抗PCNN和数据库扩展的关系抽取算法性能改进

Improving Performance of Relation Extraction Algorithm via Leveled Adversarial PCNN and Database Expansion

Diyah Puspitaningrum

摘要:

本研究采用最小描述长度(MDL)算法扩展数据库,以更好地进行关系抽取。与以往的关系抽取研究不同,本文的方法通过扩展数据来提高系统性能。数据库扩展的目标连同鲁棒的深度学习分类器一起是减少由于关系数据库中的关系实例的不完整或未找到的性质而导致的错误标签(例如,游离碱)。该研究使用深度学习方法(分段卷积神经网络或PCNN)作为我们提出的方法的基础分类器:水平对抗注意力神经网络(LATTADV-ATT)。在数据库扩展过程中,采用语义实体识别的方法,利用数据中最常见模式的最相似项集来扩展新的实例,得到其实体对。关于深度学习方法,在PCNN中使用选择性句子的注意力可以减少噪声句子。此外,对抗扰动训练的使用是有用的,以提高系统性能的鲁棒性。使用分级策略和数据库扩展的组合,性能得到进一步提高。有两个问题:1)数据库扩展方法:通过在最相似项集的强语义上允许步长来生成规则,目的是找到用于生成实例的实体对; 2)更好的分类器模型用于关系抽取。实验结果表明,使用该数据库扩展是有益的。与未扩展的方法相比,MDL数据库扩展有助于所有方法的改进。LATTADV-ATT表现为具有高精度P@100=0.842(未扩展)的良好分类器。当在P@100=0.891(在扩展因子k=7时)的扩展数据上实现时,它甚至更好。

英文摘要:

This study introduces database expansion using the Minimum Description Length (MDL) algorithm to expand the database for better relation extraction. Different from other previous relation extraction researches, our method improves system performance by expanding data. The goal of database expansion, together with a robust deep learning classifier, is to diminish wrong labels due to the incomplete or not found nature of relation instances in the relation database (e.g., Freebase). The study uses a deep learning method (Piecewise Convolutional Neural Network or PCNN) as the base classifier of our proposed approach: the leveled adversarial attention neural networks (LATTADV-ATT). In the database expansion process, the semantic entity identification is used to enlarge new instances using the most similar itemsets of the most common patterns of the data to get its pairs of entities. About the deep learning method, the use of attention of selective sentences in PCNN can reduce noisy sentences. Also, the use of adversarial perturbation training is useful to improve the robustness of system performance. The performance even further is improved using a combination of leveled strategy and database expansion. There are two issues: 1) database expansion method: rule generation by allowing step sizes on selected strong semantic of most similar itemsets with aims to find entity pair for generating instances, 2) a better classifier model for relation extraction. Experimental result has shown that the use of the database expansion is beneficial. The MDL database expansion helps improvements in all methods compared to the unexpanded method. The LATTADV-ATT performs as a good classifier with high precision P@100=0.842 (at no expansion). It is even better while implemented on the expansion data with P@100=0.891 (at expansion factor k=7).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑