arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1805.03330cs.CL
收藏

基于ASCII编码的汉英翻译

Character-level Chinese-English Translation through ASCII Encoding

Institute of Neuroinformatics, University of Zürich and ETH Zürich(苏黎世大学与苏黎世联邦理工学院神经信息学研究所)

Nikola I. Nikolov, Yuhuang Hu, Mi Xue Tan, Richard H. R. Hahnloser

摘要:

神经网络机器翻译(NMT)模型最近在许多语言对上取得了令人印象深刻的结果。它们主要适用于印欧语言对,这些语言共享相同的书写系统。然而,对于汉英翻译来说,两种不同的书写系统之间的差距构成了一个重大挑战,因为单个语言单位之间缺乏系统的对应关系。在本文中,我们使字符级的NMT为中国,打破了中国的字符到语言单位类似的印欧语言。我们使用五笔编码方案,它保留了字符的原始形状和语义信息,同时也是可逆的。我们展示了在字符和子字级别上使用递归和卷积模型训练基于Wubi的模型的有希望的结果。

英文摘要:

Character-level Neural Machine Translation (NMT) models have recently achieved impressive results on many language pairs. They mainly do well for Indo-European language pairs, where the languages share the same writing system. However, for translating between Chinese and English, the gap between the two different writing systems poses a major challenge because of a lack of systematic correspondence between the individual linguistic units. In this paper, we enable character-level NMT for Chinese, by breaking down Chinese characters into linguistic units similar to that of Indo-European languages. We use the Wubi encoding scheme, which preserves the original shape and semantic information of the characters, while also being reversible. We show promising results from training Wubi-based models on the character- and subword-level with recurrent as well as convolutional models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑