通用命名实体识别v2:迈向大规模多语言命名实体识别基准
Universal NER v2: Towards a Massively Multilingual Named Entity Recognition Benchmark
AI总结:
本文提出Universal NER v2,旨在构建多语言命名实体识别基准数据集,通过通用标签集和详尽标注指南实现标准化跨语言标注,提升多语言NER评估的准确性与一致性。
摘要:
尽管多语言模型承诺为多种语言的使用者带来LLM的好处,但大多数语言中用于检验这些假设的黄金标准评估基准仍然稀缺。Universal NER项目现已进入第四年,致力于构建黄金标准的多语言命名实体识别(NER)基准数据集。受现有大规模多语言努力(如通用依赖关系)的启发,该项目使用通用标签集和详尽的标注指南,收集标准化的跨语言命名实体跨度标注。第一版(UNER v1)于2024年发布,此后项目持续扩展,由多个组织者、标注者和合作者在活跃社区中继续推进。
英文摘要:
While multilingual language models promise to bring the benefits of LLMs to speakers of many languages, gold-standard evaluation benchmarks in most languages to interrogate these assumptions remain scarce. The Universal NER project, now entering its fourth year, is dedicated to building gold-standard multilingual Named Entity Recognition (NER) benchmark datasets. Inspired by existing massively multilingual efforts for other core NLP tasks (e.g., Universal Dependencies), the project uses a general tagset and thorough annotation guidelines to collect standardized, cross-lingual annotations of named entity spans. The first installment (UNER v1) was released in 2024, and the project has continued and expanded since then, with various organizers, annotators, and collaborators in an active community.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。