arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2604.12744cs.CL

通用命名实体识别v2:迈向大规模多语言命名实体识别基准

Universal NER v2: Towards a Massively Multilingual Named Entity Recognition Benchmark

Northeastern University, USA(东北大学);Duolingo, USA(Duolingo);Comenius University Bratislava, Slovakia(布拉迪斯拉发康门尼大学);University of British Columbia, Canada(不列颠哥伦比亚大学);Alpinference, France(Alpinference);Research Institute for Artificial Intelligence, Romanian Academy, Romania(罗马尼亚科学院人工智能研究所);University of Ljubljana, Slovenia(卢布尔雅那大学);Aristotle University of Thessaloniki / ILSP, Athena Research Center, Greece(雅典纳基大学 / ILSP, 雅典研究中心);Universitas Pelita Harapan, Indonesia(佩利塔哈盼望大学);Seoul National University, South Korea(首尔国立大学);Independent Researcher, South Korea(韩国独立研究员);Democritus University of Thrace, Greece(特拉布宗大学);Ben-Gurion University of the Negev, Israel(贝尼·格里大学)
Terra Blevins, Stephen Mayhew, Marek Šuppa, Hila Gonen, Shachar Mirkin, Vasile Pais, Kaja Dobrovoljc, Voula Giouli, Jun Kevin, Eugene Jang, Eungseo Kim, Jeongye… 展开作者

Terra Blevins, Stephen Mayhew, Marek Šuppa, Hila Gonen, Shachar Mirkin, Vasile Pais, Kaja Dobrovoljc, Voula Giouli, Jun Kevin, Eugene Jang, Eungseo Kim, Jeongyeon Seo, Xenophon Gialis, Yuval Pinter

AI总结:

本文提出Universal NER v2,旨在构建多语言命名实体识别基准数据集,通过通用标签集和详尽标注指南实现标准化跨语言标注,提升多语言NER评估的准确性与一致性。

摘要:

尽管多语言模型承诺为多种语言的使用者带来LLM的好处,但大多数语言中用于检验这些假设的黄金标准评估基准仍然稀缺。Universal NER项目现已进入第四年,致力于构建黄金标准的多语言命名实体识别(NER)基准数据集。受现有大规模多语言努力(如通用依赖关系)的启发,该项目使用通用标签集和详尽的标注指南,收集标准化的跨语言命名实体跨度标注。第一版(UNER v1)于2024年发布,此后项目持续扩展,由多个组织者、标注者和合作者在活跃社区中继续推进。

英文摘要:

While multilingual language models promise to bring the benefits of LLMs to speakers of many languages, gold-standard evaluation benchmarks in most languages to interrogate these assumptions remain scarce. The Universal NER project, now entering its fourth year, is dedicated to building gold-standard multilingual Named Entity Recognition (NER) benchmark datasets. Inspired by existing massively multilingual efforts for other core NLP tasks (e.g., Universal Dependencies), the project uses a general tagset and thorough annotation guidelines to collect standardized, cross-lingual annotations of named entity spans. The first installment (UNER v1) was released in 2024, and the project has continued and expanded since then, with various organizers, annotators, and collaborators in an active community.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑