科莫多：印度尼西亚地区语言的语言学远征
Komodo: A Linguistic Expedition into Indonesia's Regional Languages
AI总结：
Komodo-7B是一个70亿参数的多语言模型，支持印尼语、英语及11种地区语言，在多项任务中超越GPT-3.5等基准，旨在弥合低资源语言差距并改善教育公平。
摘要：
大型语言模型（LLM）的最新突破主要集中在易于获取且资源充足的语言上，如英语。然而，对于在公共领域缺乏足够语言资源的语言，仍然存在显著差距。我们的工作引入了Komodo-7B，这是一个70亿参数的大型语言模型，旨在通过无缝处理印度尼西亚语、英语以及印度尼西亚的11种地区语言来弥合这一差距。Komodo-7B是一个LLM家族，包括Komodo-7B-Base和Komodo-7B-Instruct。Komodo-7B-Instruct在各种任务和语言中取得了最先进的性能，超越了OpenAI的GPT-3.5、Cohere的Aya-101、Llama-2-Chat-13B、Mixtral-8x7B-Instruct-v0.1、Gemma-7B-it等设定的基准。该模型不仅在特定语言和整体评估中表现出卓越性能，还突出了其在语言多样性方面的卓越能力。我们致力于推进语言模型的发展，不仅限于资源丰富的语言，还旨在弥合那些语言资源有限的差距。此外，Komodo-7B-Instruct更好的跨语言理解有助于解决印度尼西亚的教育差距，提供从英语到11种地区语言的直接翻译，与现有的语言翻译服务相比有显著改进。Komodo-7B代表了语言模型包容性和有效性的关键一步，满足了不同社区的语言需求。
英文摘要：
The recent breakthroughs in Large Language Models (LLMs) have mostly focused on languages with easily available and sufficient resources, such as English. However, there remains a significant gap for languages that lack sufficient linguistic resources in the public domain. Our work introduces Komodo-7B, 7-billion-parameter Large Language Models designed to address this gap by seamlessly operating across Indonesian, English, and 11 regional languages in Indonesia. Komodo-7B is a family of LLMs that consist of Komodo-7B-Base and Komodo-7B-Instruct. Komodo-7B-Instruct stands out by achieving state-of-the-art performance in various tasks and languages, outperforming the benchmarks set by OpenAI's GPT-3.5, Cohere's Aya-101, Llama-2-Chat-13B, Mixtral-8x7B-Instruct-v0.1, Gemma-7B-it , and many more. This model not only demonstrates superior performance in both language-specific and overall assessments but also highlights its capability to excel in linguistic diversity. Our commitment to advancing language models extends beyond well-resourced languages, aiming to bridge the gap for those with limited linguistic assets. Additionally, Komodo-7B-Instruct's better cross-language understanding contributes to addressing educational disparities in Indonesia, offering direct translations from English to 11 regional languages, a significant improvement compared to existing language translation services. Komodo-7B represents a crucial step towards inclusivity and effectiveness in language models, providing to the linguistic needs of diverse communities.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
