arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.18209cs.CL
收藏

DANSK 与 DaCy 2.6.0:丹麦语命名实体识别的领域泛化

DANSK and DaCy 2.6.0: Domain Generalization of Danish Named Entity Recognition

Aarhus University(奥胡斯大学)

Kenneth Enevoldsen, Emil Trenckner Jessen, Rebekah Baglini

AI总结:

本文针对丹麦语 NER 数据稀缺、细粒度识别与跨领域评估不足的问题,发布 DANSK 数据集和 DaCy 2.6.0 模型,并评估最先进模型的领域泛化表现。

摘要:

命名实体识别是丹麦语 NLP 的基石之一,对工业界和学术界的语言技术应用都至关重要。然而,丹麦语 NER 受到可用数据集匮乏的制约。因此,当前没有模型能够进行细粒度命名实体识别,也没有模型接受过跨数据集和跨领域潜在泛化性问题的评估。为缓解这些局限,本文介绍:1)DANSK,一个命名实体数据集,提供高粒度标注,并支持在多样化领域集合中对模型进行领域内评估;2)DaCy 2.6.0,其中包含三个具备细粒度标注的可泛化模型;以及 3)一项针对当前最先进模型跨领域泛化能力的评估。对现有模型和新模型的评估揭示了不同领域之间显著的性能差异,该领域应对此加以解决。本文还讨论了数据集标注质量的不足及其对模型训练和评估的影响。尽管存在这些局限,我们仍提倡使用新数据集 DANSK,并进一步开展丹麦语 NER 泛化性研究。

英文摘要:

Named entity recognition is one of the cornerstones of Danish NLP, essential for language technology applications within both industry and research. However, Danish NER is inhibited by a lack of available datasets. As a consequence, no current models are capable of fine-grained named entity recognition, nor have they been evaluated for potential generalizability issues across datasets and domains. To alleviate these limitations, this paper introduces: 1) DANSK: a named entity dataset providing for high-granularity tagging as well as within-domain evaluation of models across a diverse set of domains; 2) DaCy 2.6.0 that includes three generalizable models with fine-grained annotation; and 3) an evaluation of current state-of-the-art models' ability to generalize across domains. The evaluation of existing and new models revealed notable performance discrepancies across domains, which should be addressed within the field. Shortcomings of the annotation quality of the dataset and its impact on model training and evaluation are also discussed. Despite these limitations, we advocate for the use of the new dataset DANSK alongside further work on the generalizability within Danish NER.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑