arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2210.10049cs.CL
收藏

阿里巴巴-翻译中国提交的WMT 2022质量评估共享任务

Alibaba-Translate China's Submission for WMT 2022 Quality Estimation Shared Task

DAMO Academy, Alibaba Group(阿里巴巴集团达摩院);University of Science and Technology of China(中国科学技术大学);University of Macau(澳门大学);National University of Singapore(新加坡国立大学)

Keqin Bao, Yu Wan, Dayiheng Liu, Baosong Yang, Wenqiang Lei, Xiangnan He, Derek F. Wong, Jun Xie

摘要:

在本文中,我们提出了我们的提交的翻译级MQM基准在质量评估共享任务,名为统一翻译评估(UniTE)。具体来说,我们的系统采用了UniTE的框架,该框架在训练过程中将三种类型的输入格式与预先训练的语言模型相结合。首先,我们将伪标记数据示例应用于连续预训练阶段。值得注意的是,为了减少预训练和微调之间的差距,我们使用了数据修剪和基于排名的分数归一化策略。在微调阶段,我们使用了过去几年WMT比赛的直接评估(DA)和多维质量评估(MQM)数据。最后,我们收集了仅源的评估结果,并集成了两个UniTE模型生成的预测,其主干分别是XLM-R和InfoXLM。结果表明,我们的模型在多语言和英俄设置中达到了第一的总排名,在英德和中英设置中达到了第二的总排名,在今年的质量评估比赛中表现出了相对较强的表现。

英文摘要:

In this paper, we present our submission to the sentence-level MQM benchmark at Quality Estimation Shared Task, named UniTE (Unified Translation Evaluation). Specifically, our systems employ the framework of UniTE, which combined three types of input formats during training with a pre-trained language model. First, we apply the pseudo-labeled data examples for the continuously pre-training phase. Notably, to reduce the gap between pre-training and fine-tuning, we use data pruning and a ranking-based score normalization strategy. For the fine-tuning phase, we use both Direct Assessment (DA) and Multidimensional Quality Metrics (MQM) data from past years' WMT competitions. Finally, we collect the source-only evaluation results, and ensemble the predictions generated by two UniTE models, whose backbones are XLM-R and InfoXLM, respectively. Results show that our models reach 1st overall ranking in the Multilingual and English-Russian settings, and 2nd overall ranking in English-German and Chinese-English settings, showing relatively strong performances in this year's quality estimation competition.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑