arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2003.14026cs.CL
收藏

MULTEXT-East

MULTEXT-East

Jožef Stefan Institute(约瑟夫·斯特凡研究所)

Tomaž Erjavec

摘要:

MULTEXT-East语言资源是用于语言工程研究的多语种数据集,侧重于语言描述的形态句法水平。MULTEXT-East数据集包括基于EAGLES的形态句法规范、形态句法词典和带注释的多语言语料库。平行语料库,小说“1984年”的乔治奥威尔,是句子对齐,并包含手工验证的形态句法描述和引理。这些资源使用文本编码倡议指南TEI P5统一编码为XML,涵盖16种语言:保加利亚语、克罗地亚语、捷克语、英语、爱沙尼亚语、匈牙利语、马其顿语、波斯语、波兰语、雷西安语、罗马尼亚语、俄语、塞尔维亚语、斯洛伐克语、斯洛文尼亚语和乌克兰语。该数据集被广泛记录,并可免费用于研究目的。本文介绍了东方多文本资源的发展历史,介绍了东方多文本资源的编码和组成,讨论了相关的工作,并给出了一些结论。

英文摘要:

MULTEXT-East language resources, a multilingual dataset for language engineering research, focused on the morphosyntactic level of linguistic description. The MULTEXT-East dataset includes the EAGLES-based morphosyntactic specifications, morphosyntactic lexicons, and an annotated multilingual corpora. The parallel corpus, the novel "1984" by George Orwell, is sentence aligned and contains hand-validated morphosyntactic descriptions and lemmas. The resources are uniformly encoded in XML, using the Text Encoding Initiative Guidelines, TEI P5, and cover 16 languages: Bulgarian, Croatian, Czech, English, Estonian, Hungarian, Macedonian, Persian, Polish, Resian, Romanian, Russian, Serbian, Slovak, Slovene, and Ukrainian. This dataset is extensively documented, and freely available for research purposes. This case study gives a history of the development of the MULTEXT-East resources, presents their encoding and components, discusses related work and gives some conclusions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑