arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2001.11285cs.CL
收藏

LowResourceEval-2019:低资源语言形态分析的共享任务

LowResourceEval-2019: a shared task on morphological analysis for low-resource languages

Institute of Linguistics, HSE(高等经济学院语言学研究所);Moscow State University(莫斯科国立大学);Moscow Institute of Physics and Technology(莫斯科物理技术学院);Institute of Applied Mathematical Research of KarRC of RAS(俄罗斯科学院卡累利阿研究中心应用数学研究所);Center for Language and Brain, HSE(高等经济学院语言与大脑中心)

Elena Klyachko, Alexey Sorokin, Natalia Krizhanovskaya, Andrew Krizhanovsky, Galina Ryazanskaya

摘要:

本文介绍了俄罗斯的语言,即鄂温克语,卡累利阿语,Selkup,和Veps的形态分析的第一个共享任务的结果。对于所讨论的语文,只有小型语料库可用。任务包括词法分析、词形生成和语素切分。四个小组参加了共同的任务。它们中的大多数使用机器学习方法,优于现有的基于规则的方法。本文描述了为共享任务准备的数据集,并包含对参与者解决方案的分析。将不同格式的语言语料库转换为CONLL-U格式。通用格式使数据集可以与其他语言的corpura相媲美,并便于在其他NLP任务中使用它们。

英文摘要:

The paper describes the results of the first shared task on morphological analysis for the languages of Russia, namely, Evenki, Karelian, Selkup, and Veps. For the languages in question, only small-sized corpora are available. The tasks include morphological analysis, word form generation and morpheme segmentation. Four teams participated in the shared task. Most of them use machine-learning approaches, outperforming the existing rule-based ones. The article describes the datasets prepared for the shared tasks and contains analysis of the participants' solutions. Language corpora having different formats were transformed into CONLL-U format. The universal format makes the datasets comparable to other language corpura and facilitates using them in other NLP tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑