乌拉尔语言识别(ULI)2020共享任务数据集和Wanca 2017语料库
Uralic Language Identification (ULI) 2020 shared task dataset and the Wanca 2017 corpus
摘要:
本文介绍了从互联网上抓取的Wanca 2017文本语料库,从中收集了用于乌拉尔语言识别(ULI)2020共享任务的稀有乌拉尔语言的句子。我们描述了ULI数据集,以及它是如何使用Wanca 2017语料库和莱比锡语料库集合中不同语言的文本构建的。我们还提供了使用ULI 2020数据集进行的基线语言识别实验。
英文摘要:
This article introduces the Wanca 2017 corpus of texts crawled from the internet from which the sentences in rare Uralic languages for the use of the Uralic Language Identification (ULI) 2020 shared task were collected. We describe the ULI dataset and how it was constructed using the Wanca 2017 corpus and texts in different languages from the Leipzig corpora collection. We also provide baseline language identification experiments conducted using the ULI 2020 dataset.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。