MSNER:一个用于命名实体识别的多语言语音数据集
MSNER: A Multilingual Speech Dataset for Named Entity Recognition
AI总结:
针对口语 NER 资源稀缺且仅限英语的问题,本文构建多语言命名实体语音数据集 MSNER,配套高效标注工具、银/金标注分析及基线模型。
摘要:
尽管命名实体识别(NER)在基于文本的任务中得到了广泛探索,但它在口语理解中仍基本被忽视。现有资源仅限于一个仅含英语的单一数据集。本文通过推出 MSNER 来弥补这一空白,这是一个免费可用、带有命名实体标注的多语言语音语料库。它为 VoxPopuli 数据集提供四种语言(荷兰语、法语、德语和西班牙语)的标注。我们还发布了一款高效的标注工具,该工具利用自动预标注来加快人工精修。由此产生了用于训练和验证的 590 小时和 15 小时银标注语音,以及一个 17 小时的人工标注评估集。我们进一步给出了比较银标注与金标注的分析。最后,我们提出了基线 NER 模型,以推动围绕这一新可用数据集开展进一步研究。
英文摘要:
While extensively explored in text-based tasks, Named Entity Recognition (NER) remains largely neglected in spoken language understanding. Existing resources are limited to a single, English-only dataset. This paper addresses this gap by introducing MSNER, a freely available, multilingual speech corpus annotated with named entities. It provides annotations to the VoxPopuli dataset in four languages (Dutch, French, German, and Spanish). We have also releasing an efficient annotation tool that leverages automatic pre-annotations for faster manual refinement. This results in 590 and 15 hours of silver-annotated speech for training and validation, alongside a 17-hour, manually-annotated evaluation set. We further provide an analysis comparing silver and gold annotations. Finally, we present baseline NER models to stimulate further research on this newly available dataset.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。