arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1908.05925cs.CL

Incorporating Word and Subword Units in Unsupervised Machine Translation Using Language Model Rescoring

Center for Artificial Intelligence Research (CAiRE)(人工智能研究中心(CAiRE));The Hong Kong University of Science and Technology(香港科技大学)

Zihan Liu, Yan Xu, Genta Indra Winata, Pascale Fung

英文摘要:

This paper describes CAiRE's submission to the unsupervised machine translation track of the WMT'19 news shared task from German to Czech. We leverage a phrase-based statistical machine translation (PBSMT) model and a pre-trained language model to combine word-level neural machine translation (NMT) and subword-level NMT models without using any parallel data. We propose to solve the morphological richness problem of languages by training byte-pair encoding (BPE) embeddings for German and Czech separately, and they are aligned using MUSE (Conneau et al., 2018). To ensure the fluency and consistency of translations, a rescoring mechanism is proposed that reuses the pre-trained language model to select the translation candidates generated through beam search. Moreover, a series of pre-processing and post-processing approaches are applied to improve the quality of final translations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑