arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.03119cs.CLcs.AI
收藏

基于Euas-20的大语言模型翻译性能评估

Evaluating the Translation Performance of Large Language Models Based on Euas-20

College of Software, Zhengzhou University of Light Industry(郑州轻工业大学软件学院)

Yan Huang, Wei Liu

AI总结:

本文构建Euas-20数据集,用于评估大语言模型的翻译性能、跨语言翻译能力及预训练数据对翻译能力的影响。

摘要:

近年来,随着深度学习技术的快速发展,BERT和GPT等大语言模型(LLMs)在自然语言处理任务中取得了突破性成果。机器翻译(MT)作为自然语言处理的核心任务之一,同样受益于大语言模型的发展,实现了质的飞跃。尽管大语言模型在翻译性能上取得了显著进步,机器翻译仍面临诸多挑战。因此,本文构建了数据集Euas-20,旨在为研究人员和开发者评估大语言模型在翻译任务上的性能、在不同语言上的翻译能力,以及预训练数据对大语言模型翻译能力的影响。

英文摘要:

In recent years, with the rapid development of deep learning technology, large language models (LLMs) such as BERT and GPT have achieved breakthrough results in natural language processing tasks. Machine translation (MT), as one of the core tasks of natural language processing, has also benefited from the development of large language models and achieved a qualitative leap. Despite the significant progress in translation performance achieved by large language models, machine translation still faces many challenges. Therefore, in this paper, we construct the dataset Euas-20 to evaluate the performance of large language models on translation tasks, the translation ability on different languages, and the effect of pre-training data on the translation ability of LLMs for researchers and developers.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑