arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.04269cs.CL
收藏

开放语言数据倡议:推进卡拉卡尔帕克语低资源机器翻译

Open Language Data Initiative: Advancing Low-Resource Machine Translation for Karakalpak

Tahrirchi(塔希尔奇)

Mukhammadsaid Mamasaidov, Abror Shopulatov

AI总结:

该研究面向卡拉卡尔帕克语低资源机器翻译,构建FLORES+评测集与三向各10万句对平行语料,开源微调神经模型并验证其优于基线。

摘要:

本研究为卡拉卡尔帕克语提出多项贡献:一个翻译成卡拉卡尔帕克语的 FLORES+ devtest 数据集,乌兹别克语-卡拉卡尔帕克语、俄语-卡拉卡尔帕克语和英语-卡拉卡尔帕克语平行语料库(各含10万个句对),以及在这些语言之间进行翻译的开源微调神经模型。我们的实验比较了不同模型变体和训练方法,证明其相较现有基线有所改进。本工作作为开放语言数据倡议(OLDI)共享任务的一部分开展,旨在提升卡拉卡尔帕克语的机器翻译能力,并为扩大NLP技术中的语言多样性作出贡献。

英文摘要:

This study presents several contributions for the Karakalpak language: a FLORES+ devtest dataset translated to Karakalpak, parallel corpora for Uzbek-Karakalpak, Russian-Karakalpak and English-Karakalpak of 100,000 pairs each and open-sourced fine-tuned neural models for translation across these languages. Our experiments compare different model variants and training approaches, demonstrating improvements over existing baselines. This work, conducted as part of the Open Language Data Initiative (OLDI) shared task, aims to advance machine translation capabilities for Karakalpak and contribute to expanding linguistic diversity in NLP technologies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑