arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2201.11258cs.CL

Learning How to Translate North Korean through South Korean

Tokyo Metropolitan University(东京都立大学);Tokyo Institute of Technology(东京工业大学);Google LLC(谷歌公司)

Hwichan Kim, Sangwhan Moon, Naoaki Okazaki, Mamoru Komachi

英文摘要:

South and North Korea both use the Korean language. However, Korean NLP research has focused on South Korean only, and existing NLP systems of the Korean language, such as neural machine translation (NMT) models, cannot properly handle North Korean inputs. Training a model using North Korean data is the most straightforward approach to solving this problem, but there is insufficient data to train NMT models. In this study, we create data for North Korean NMT models using a comparable corpus. First, we manually create evaluation data for automatic alignment and machine translation. Then, we investigate automatic alignment methods suitable for North Korean. Finally, we verify that a model trained by North Korean bilingual data without human annotation can significantly boost North Korean translation accuracy compared to existing South Korean models in zero-shot settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑