arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.08332cs.CL
收藏

低资源语言对的增强翻译技术:梵语到印地语的翻译

An Augmented Translation Technique for low Resource language pair: Sanskrit to Hindi translation

Malaviya National Institute of Technology(马拉维亚国家技术学院)

Rashi Kumar, Piyush Jha, Vineet Sahula

摘要:

神经机器翻译(Neural Machine Translation,NMT)是一种利用大型人工神经网络进行机器翻译(Machine Translation,MT)的新兴技术。它已经展示了有希望的结果,并在解决具有挑战性的机器翻译练习方面显示出令人难以置信的潜力。其中一个练习是用一点准备信息为语言集提供大量MT的最佳方法。在这项工作中,Zero Shot Translation(ZST)检查低资源语言对。通过对高资源语言对进行工作,即西班牙语到葡萄牙语,并对数据集进行训练(西班牙语-英语和英语-葡萄牙语),我们为ZST系统准备了一个证明状态,该系统可以根据可用数据提供适当的结果。随后,通过在英语-印地语和梵语-英语语言对上训练模型,对数据稀疏的梵语到印地语翻译测试相同的架构。为了使用ZST系统进行准备和解密,我们扩展了Tensorflow中NMT seq 2seq模型的准备和解释管道,并结合了ZST功能。通过对词嵌入进行语义缩减,减少了数据存储的内存占用,加快了训练和翻译周期。在这项工作中,我们以富有想象力的方式利用现有的有用技术来执行我们的NLP问题,即梵语到印地语的翻译。一个梵语-印地语平行语料库的300构建测试。建立平行语料库所需的数据取自印度中央邦政府新闻部网站上发布的电视新闻。

英文摘要:

Neural Machine Translation (NMT) is an ongoing technique for Machine Translation (MT) using enormous artificial neural network. It has exhibited promising outcomes and has shown incredible potential in solving challenging machine translation exercises. One such exercise is the best approach to furnish great MT to language sets with a little preparing information. In this work, Zero Shot Translation (ZST) is inspected for a low resource language pair. By working on high resource language pairs for which benchmarks are available, namely Spanish to Portuguese, and training on data sets (Spanish-English and English-Portuguese) we prepare a state of proof for ZST system that gives appropriate results on the available data. Subsequently the same architecture is tested for Sanskrit to Hindi translation for which data is sparse, by training the model on English-Hindi and Sanskrit-English language pairs. In order to prepare and decipher with ZST system, we broaden the preparation and interpretation pipelines of NMT seq2seq model in tensorflow, incorporating ZST features. Dimensionality reduction of word embedding is performed to reduce the memory usage for data storage and to achieve a faster training and translation cycles. In this work existing helpful technology has been utilized in an imaginative manner to execute our NLP issue of Sanskrit to Hindi translation. A Sanskrit-Hindi parallel corpus of 300 is constructed for testing. The data required for the construction of parallel corpus has been taken from the telecasted news, published on Department of Public Information, state government of Madhya Pradesh, India website.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑