arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2203.08259cs.CLcs.AI
收藏

低资源语料挖掘的质量评估

Better Quality Estimation for Low Resource Corpus Mining

Boston University(波士顿大学)

Muhammed Yusuf Kocyigit, Jiho Lee, Derry Wijaya

摘要:

质量评估(QE)模型有可能改变我们评估甚至训练机器翻译模型的方式。然而,这些模型仍然缺乏实现普遍采用的鲁棒性。我们表明,国家的最先进的QE模型,在并行语料库挖掘(PCM)设置测试时,执行意外的坏,由于缺乏鲁棒性域外的例子。我们提出了多任务训练,数据增强和对比学习的组合,以实现更好,更强大的QE性能。我们表明,我们的方法提高QE性能显着的MLQE的挑战和QE模型的鲁棒性时,在并行语料库挖掘设置测试。我们将PCM的准确性提高了0.80以上,使其与使用数百万个句子对来训练模型的最先进的PCM方法不相上下。相比之下,我们使用了千分之一的数据,总共7K个并行句子,并提出了一种新的低资源PCM方法。

英文摘要:

Quality Estimation (QE) models have the potential to change how we evaluate and maybe even train machine translation models. However, these models still lack the robustness to achieve general adoption. We show that State-of-the-art QE models, when tested in a Parallel Corpus Mining (PCM) setting, perform unexpectedly bad due to a lack of robustness to out-of-domain examples. We propose a combination of multitask training, data augmentation and contrastive learning to achieve better and more robust QE performance. We show that our method improves QE performance significantly in the MLQE challenge and the robustness of QE models when tested in the Parallel Corpus Mining setup. We increase the accuracy in PCM by more than 0.80, making it on par with state-of-the-art PCM methods that use millions of sentence pairs to train their models. In comparison, we use a thousand times less data, 7K parallel sentences in total, and propose a novel low resource PCM method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑