arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2203.09027cs.CL
收藏

三角形转移:冻结三角形机器翻译的枢轴

Triangular Transfer: Freezing the Pivot for Triangular Machine Translation

Huawei Noah’s Ark Lab(华为诺亚方舟实验室)

Meng Zhang, Liangyou Li, Qun Liu

摘要:

三角机器翻译是低资源机器翻译的一种特殊情况,其中感兴趣的语言对具有有限的并行数据,但两种语言都具有丰富的并行数据与枢轴语言。自然,三角形机器翻译的关键是成功地利用这种辅助数据。在这项工作中,我们提出了一种基于迁移学习的方法,利用所有类型的辅助数据。当我们训练辅助源-枢轴和辅助目标-目标翻译模型时,我们使用预训练的语言模型初始化枢轴侧的一些参数,并冻结它们以鼓励两个翻译模型在相同的枢轴语言空间中工作,以便它们可以平滑地转换到源-目标翻译模型。实验表明,我们的方法可以优于以前的。

英文摘要:

Triangular machine translation is a special case of low-resource machine translation where the language pair of interest has limited parallel data, but both languages have abundant parallel data with a pivot language. Naturally, the key to triangular machine translation is the successful exploitation of such auxiliary data. In this work, we propose a transfer-learning-based approach that utilizes all types of auxiliary data. As we train auxiliary source-pivot and pivot-target translation models, we initialize some parameters of the pivot side with a pre-trained language model and freeze them to encourage both translation models to work in the same pivot language space, so that they can be smoothly transferred to the source-target translation model. Experiments show that our approach can outperform previous ones.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑