arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.21330cs.CL
收藏

近期大型语言模型在低资源语言上的表现

Performance of Recent Large Language Models for a Low-Resourced Language

University of Moratuwa(莫拉图瓦大学)

Ravindu Jayakody, Gihan Dias

AI总结:

本文评估了四款近期LLMs在低资源语言僧伽罗语上的直接表现、英译互译能力及少量数据微调潜力,发现Claude和GPT 4o开箱即用表现优异,而Llama和Mistral虽表现不佳但微调后有改进空间。

摘要:

大型语言模型(LLMs)在过去一年中取得了显著进展。除了新版GPT和Llama之外,近期还推出了多款其他LLMs,其中一些是可供下载和修改的开放模型。尽管多语言大型语言模型已经存在了一段时间,但它们在僧伽罗语等低资源语言上的表现一直不佳。我们评估了四款近期LLMs直接使用僧伽罗语的表现,以及通过英语互译的表现。我们还评估了它们在少量微调数据下的可微调性。Claude和GPT 4o开箱即用表现良好,且明显优于先前版本。Llama和Mistral表现不佳,但通过微调显示出一定的改进潜力。

英文摘要:

Large Language Models (LLMs) have shown significant advances in the past year. In addition to new versions of GPT and Llama, several other LLMs have been introduced recently. Some of these are open models available for download and modification. Although multilingual large language models have been available for some time, their performance on low-resourced languages such as Sinhala has been poor. We evaluated four recent LLMs on their performance directly in the Sinhala language, and by translation to and from English. We also evaluated their fine-tunability with a small amount of fine-tuning data. Claude and GPT 4o perform well out-of-the-box and do significantly better than previous versions. Llama and Mistral perform poorly but show some promise of improvement with fine tuning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑