arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2310.14644cs.CL

多语言k近邻机器翻译

Multilingual k-Nearest-Neighbor Machine Translation

University of Amsterdam(阿姆斯特丹大学)

David Stap, Christof Monz

AI总结:

本文提出将多种语言表示组合到单一数据存储中,解决k近邻机器翻译在低资源语言上的局限,不仅提升了低资源翻译质量,还通过利用语言相似性缩小数据存储规模并大幅提高速度。

摘要:

k近邻机器翻译通过创建缓存示例的数据存储,在机器翻译质量上展现出显著提升。然而,这些提升仅限于具有大型数据存储的高资源语言对,对低资源语言仍是一项挑战。在本文中,我们通过将多种语言的表示组合到单一数据存储中来解决这一问题。我们的结果一致表明,不仅在低资源翻译质量上有大幅提升(高达+3.6 BLEU),在高资源翻译质量上也有所提高(高达+0.5 BLEU)。实验表明,利用语言相似性创建数据存储,可以构建大小仅为四分之一的多语言数据存储,实现5.3倍的速度提升。

英文摘要:

k-nearest-neighbor machine translation has demonstrated remarkable improvements in machine translation quality by creating a datastore of cached examples. However, these improvements have been limited to high-resource language pairs, with large datastores, and remain a challenge for low-resource languages. In this paper, we address this issue by combining representations from multiple languages into a single datastore. Our results consistently demonstrate substantial improvements not only in low-resource translation quality (up to +3.6 BLEU), but also for high-resource translation quality (up to +0.5 BLEU). Our experiments show that it is possible to create multilingual datastores that are a quarter of the size, achieving a 5.3x speed improvement, by using linguistic similarities for datastore creation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑