arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2101.05162cs.CL
收藏

乌兹别克语西里尔-拉丁-西里尔机器音译

Uzbek Cyrillic-Latin-Cyrillic Machine Transliteration

Copper City Labs

B. Mansurov, A. Mansurov

摘要:

在本文中,我们介绍了一种数据驱动的方法来音译乌兹别克语字典单词从西里尔字母到拉丁字母,反之亦然。我们将源脚本中的单词字符与目标脚本中相应单词的子字符串对齐,并训练一个学习这些对齐的决策树分类器。在测试集上,我们的西里尔文到拉丁文模型实现了0.9992的字符级微平均F1得分,我们的拉丁文到西里尔文模型实现了0.9959的得分。我们的贡献是一种新的方法,为低资源的乌兹别克语生产机器音译文本。

英文摘要:

In this paper, we introduce a data-driven approach to transliterating Uzbek dictionary words from the Cyrillic script into the Latin script, and vice versa. We heuristically align characters of words in the source script with sub-strings of the corresponding words in the target script and train a decision tree classifier that learns these alignments. On the test set, our Cyrillic to Latin model achieves a character level micro-averaged F1 score of 0.9992, and our Latin to Cyrillic model achieves the score of 0.9959. Our contribution is a novel method of producing machine transliterated texts for the low-resource Uzbek language.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑