arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.09887cs.CLcs.AI
收藏

Sabiá-2:新一代葡萄牙语大语言模型

Sabiá-2: A New Generation of Portuguese Large Language Models

Maritaca AI(马里塔卡人工智能公司)

Thales Sales Almeida, Hugo Abonizio, Rodrigo Nogueira, Ramon Pires

AI总结:

本文提出葡萄牙语大语言模型家族Sabiá-2,其中Sabiá-2 Medium在多数考试中超越GPT-3.5并在部分考试中匹敌GPT-4,且通过专业化以更低成本实现高性能,同时指出数学与编程能力仍需提升。

摘要:

我们介绍了Sabiá-2,一个基于葡萄牙语文本训练的大语言模型家族。这些模型在多种考试上进行了评估,包括巴西大学入学测试、职业认证考试,以及涵盖会计、经济、工程、法律和医学等多个学科的研究生水平考试。结果表明,我们目前最好的模型Sabiá-2 Medium在64项考试中的23项上达到或超过GPT-4的性能,并在64项考试中的58项上优于GPT-3.5。值得注意的是,专业化对模型性能有显著影响,而无需增加模型规模,这使我们能够以比GPT-4便宜10倍的每token价格提供Sabiá-2 Medium。最后,我们发现数学和编程是需要改进的关键能力。

英文摘要:

We introduce Sabiá-2, a family of large language models trained on Portuguese texts. The models are evaluated on a diverse range of exams, including entry-level tests for Brazilian universities, professional certification exams, and graduate-level exams for various disciplines such as accounting, economics, engineering, law and medicine. Our results reveal that our best model so far, Sabiá-2 Medium, matches or surpasses GPT-4's performance in 23 out of 64 exams and outperforms GPT-3.5 in 58 out of 64 exams. Notably, specialization has a significant impact on a model's performance without the need to increase its size, allowing us to offer Sabiá-2 Medium at a price per token that is 10 times cheaper than GPT-4. Finally, we identified that math and coding are key abilities that need improvement.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑