arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1803.03378cs.CL
收藏

具有层次感知损失的神经细粒度实体类型分类

Neural Fine-Grained Entity Type Classification with Hierarchy-Aware Loss

University of Alberta(阿尔伯塔大学);Department of Computing Science(计算机科学系)

Peng Xu, Denilson Barbosa

摘要:

细粒度实体类型分类(FETC)的任务包括将层次结构中的类型分配给文本中的实体提及。现有的方法依赖于远程监督,因此容易受到噪声标签的影响,这些标签可能是上下文之外的,或者对于训练句子来说过于具体。以前试图解决这些问题的方法是使用人工智能或手工制作的功能。相反,我们提出了一个端到端的解决方案,使用一个神经网络模型,使用交叉熵损失函数的变体来处理上下文外的标签,和层次损失归一化来处理过于具体的。此外,以前的工作解决了FETC多标签分类,然后进行特设后处理。相比之下,我们的解决方案更优雅:我们使用公共词嵌入来训练单个标签,该标签联合学习实体提及及其上下文的表示。我们的实验表明,我们的方法对噪声是鲁棒的,并始终优于国家的最先进的既定基准的任务。

英文摘要:

The task of Fine-grained Entity Type Classification (FETC) consists of assigning types from a hierarchy to entity mentions in text. Existing methods rely on distant supervision and are thus susceptible to noisy labels that can be out-of-context or overly-specific for the training sentence. Previous methods that attempt to address these issues do so with heuristics or with the help of hand-crafted features. Instead, we propose an end-to-end solution with a neural network model that uses a variant of cross- entropy loss function to handle out-of-context labels, and hierarchical loss normalization to cope with overly-specific ones. Also, previous work solve FETC a multi-label classification followed by ad-hoc post-processing. In contrast, our solution is more elegant: we use public word embeddings to train a single-label that jointly learns representations for entity mentions and their context. We show experimentally that our approach is robust against noise and consistently outperforms the state-of-the-art on established benchmarks for the task.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑