arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2104.07249cs.CLcs.AI
收藏

长命名实体识别的正则化方法

Regularization for Long Named Entity Recognition

Korea University(高丽大学)

Minbyul Jeong, Jaewoo Kang

摘要:

当执行命名实体识别(NER)时,实体长度是可变的,并且取决于特定的域或数据集。预训练的语言模型(PLM)用于解决NER任务,并且倾向于偏向于数据集模式,例如长度统计,表面形式和倾斜的类分布。这些偏见阻碍了PLM的泛化能力,这是解决现实世界中许多看不见的提及所必需的。我们提出了一种新的去偏置方法RegLER,以提高不同长度的实体的预测。为了缩小评估和现实情况之间的差距,我们在包含未见过的提及集的分区基准数据集上评估了PLM。在这里,RegLER显示了对长名称实体的显著改进,长名称实体可以通过对实体内的合取或专用字符进行去偏置来进行预测。此外,在大多数NER数据集中存在严重的类别不平衡,导致容易否定的示例在训练期间占主导地位,例如“The”。我们的方法通过减少易负的例子的影响来消除倾斜的类分布。在生物医学和一般领域的实验证明了我们的方法的泛化能力。为了促进可重复性和未来的工作,我们发布了我们的代码。“网址:https://github.com/minstar/RegLER“

英文摘要:

When performing named entity recognition (NER), entity length is variable and dependent on a specific domain or dataset. Pre-trained language models (PLMs) are used to solve NER tasks and tend to be biased toward dataset patterns such as length statistics, surface form, and skewed class distribution. These biases hinder the generalization ability of PLMs, which is necessary to address many unseen mentions in real-world situations. We propose a novel debiasing method RegLER to improve predictions for entities of varying lengths. To close the gap between evaluation and real-world situations, we evaluated PLMs on partitioned benchmark datasets containing unseen mention sets. Here, RegLER shows significant improvement over long-named entities that can predict through debiasing on conjunction or special characters within entities. Furthermore, there is a severe class imbalance in most NER datasets, causing easy-negative examples to dominate during training, such as "The". Our approach alleviates skewed class distribution by reducing the influence of easy-negative examples. Extensive experiments on the biomedical and general domains demonstrated the generalization capabilities of our method. To facilitate reproducibility and future work, we release our code."https://github.com/minstar/RegLER"

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑