arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1612.07486cs.CL
收藏

使用语言向量的持续多语言性

Continuous multilinguality with language vectors

Stockholm University(斯德哥尔摩大学);University of Helsinki(赫尔辛基大学)

Robert Östling, Jörg Tiedemann

摘要:

大多数现有的多语言自然语言处理(NLP)模型将语言视为离散的类别,并对一种语言或另一种语言进行预测。相反,我们建议使用语言的连续向量表示。我们表明,这些可以有效地学习与基于字符的神经语言模型,并用于改善在训练过程中看不到的语言品种的推理。在1303圣经翻译成990种不同语言的实验中,我们经验性地探索了多语言语言模型的能力,并表明语言向量捕捉语言之间的遗传关系。

英文摘要:

Most existing models for multilingual natural language processing (NLP) treat language as a discrete category, and make predictions for either one language or the other. In contrast, we propose using continuous vector representations of language. We show that these can be learned efficiently with a character-based neural language model, and used to improve inference about language varieties not seen during training. In experiments with 1303 Bible translations into 990 different languages, we empirically explore the capacity of multilingual language models, and also show that the language vectors capture genetic relationships between languages.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑