arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2008.08769cs.CL
收藏

葡萄牙语-英语和英语-葡萄牙语翻译的Lite培训策略

Lite Training Strategies for Portuguese-English and English-Portuguese Translation

Institute of Computing, University of Campinas(坎皮纳斯大学计算研究所);School of Electrical and Computer Engineering, University of Campinas(坎皮纳斯大学电气与计算机工程学院);NeuralMind Inteligência Artificial(NeuralMind 人工智能公司);David R. Cheriton School of Computer Science, University of Waterloo(滑铁卢大学 David R. Cheriton 计算机科学学院)

Alexandre Lopes, Rodrigo Nogueira, Roberto Lotufo, Helio Pedrini

摘要:

尽管深度学习广泛应用于机器翻译,但开发高质量的翻译模型仍然很昂贵。在这项工作中,我们研究了预训练模型的使用,例如使用低成本硬件进行葡萄牙语-英语和英语-葡萄牙语翻译任务的T5。我们探讨使用葡萄牙语和英语预训练的语言模型,并提出了适应的英语tokenizer代表葡萄牙语字符,如分音符,急性和严重的口音。我们将我们的模型与ParaCrawl数据集子集上的Google翻译API和MarianMT进行了比较,并与WMT 19生物医学翻译共享任务的获奖提交进行了比较。我们还介绍了我们提交的WMT 20生物医学翻译共享任务。我们的结果表明,我们的模型在适度的硬件上(一个8 GB的游戏GPU持续九天)训练时,具有与最先进的模型相竞争的性能。我们的数据、模型和代码可在https://github.com/unicamp-dl/Lite-T5-Translation上获得。

英文摘要:

Despite the widespread adoption of deep learning for machine translation, it is still expensive to develop high-quality translation models. In this work, we investigate the use of pre-trained models, such as T5 for Portuguese-English and English-Portuguese translation tasks using low-cost hardware. We explore the use of Portuguese and English pre-trained language models and propose an adaptation of the English tokenizer to represent Portuguese characters, such as diaeresis, acute and grave accents. We compare our models to the Google Translate API and MarianMT on a subset of the ParaCrawl dataset, as well as to the winning submission to the WMT19 Biomedical Translation Shared Task. We also describe our submission to the WMT20 Biomedical Translation Shared Task. Our results show that our models have a competitive performance to state-of-the-art models while being trained on modest hardware (a single 8GB gaming GPU for nine days). Our data, models and code are available at https://github.com/unicamp-dl/Lite-T5-Translation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑