arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2012.03536cs.CL

H-FND: Hierarchical False-Negative Denoising for Distant Supervision Relation Extraction

UC Los Angeles(加州大学洛杉矶分校);UC Santa Barbara(加州大学圣巴巴拉分校);Academia Sinica(中央研究院)

Jhih-Wei Chen, Tsu-Jui Fu, Chen-Kang Lee, Wei-Yun Ma

英文摘要:

Although distant supervision automatically generates training data for relation extraction, it also introduces false-positive (FP) and false-negative (FN) training instances to the generated datasets. Whereas both types of errors degrade the final model performance, previous work on distant supervision denoising focuses more on suppressing FP noise and less on resolving the FN problem. We here propose H-FND, a hierarchical false-negative denoising framework for robust distant supervision relation extraction, as an FN denoising solution. H-FND uses a hierarchical policy which first determines whether non-relation (NA) instances should be kept, discarded, or revised during the training process. For those learning instances which are to be revised, the policy further reassigns them appropriate relations, making them better training inputs. Experiments on SemEval-2010 and TACRED were conducted with controlled FN ratios that randomly turn the relations of training and validation instances into negatives to generate FN instances. In this setting, H-FND can revise FN instances correctly and maintains high F1 scores even when 50% of the instances have been turned into negatives. Experiment on NYT10 is further conducted to shows that H-FND is applicable in a realistic setting.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑