PLLuM：波兰大语言模型系列
PLLuM: A Family of Polish Large Language Models
AI总结：
PLLuM 是波兰研究机构联合开发的最大开源波兰语大语言模型系列，通过构建大规模波兰语语料库、指令与偏好数据集及负责任人工智能框架，提升波兰语 AI 能力并推动主权人工智能技术发展。
摘要：
大语言模型（LLMs）在现代人工智能中扮演核心角色，但其发展主要集中于英语，导致对其他语言的支持有限。我们推出 PLLuM（Polish Large Language Model，波兰大语言模型），这是专为波兰语量身打造的最大开源基础模型系列。PLLuM 由波兰主要研究机构组成的联合体开发，旨在满足超越以英语为中心的商业格局之外对高质量、透明且具有文化相关性的语言模型的需求。我们描述了开发过程，包括构建一个用于预训练的全新 1400 亿 token 波兰语文本语料库、一个 77k 条自定义指令数据集，以及一个 100k 条偏好优化数据集。一个关键组成部分是负责任人工智能框架，该框架纳入了严格的数据治理以及一个用于输出纠正和安全过滤的混合模块。我们详细介绍了基础版和指令微调版模型的架构、训练流程和对齐技术，并展示了它们在公共行政领域下游任务中的实用性。通过公开发布这些模型，PLLuM 旨在促进开放研究并加强波兰的主权人工智能技术。
英文摘要：
Large Language Models (LLMs) play a central role in modern artificial intelligence, yet their development has been primarily focused on English, resulting in limited support for other languages. We present PLLuM (Polish Large Language Model), the largest open-source family of foundation models tailored specifically for the Polish language. Developed by a consortium of major Polish research institutions, PLLuM addresses the need for high-quality, transparent, and culturally relevant language models beyond the English-centric commercial landscape. We describe the development process, including the construction of a new 140-billion-token Polish text corpus for pre-training, a 77k custom instructions dataset, and a 100k preference optimization dataset. A key component is a Responsible AI framework that incorporates strict data governance and a hybrid module for output correction and safety filtering. We detail the models' architecture, training procedures, and alignment techniques for both base and instruction-tuned variants, and demonstrate their utility in a downstream task within public administration. By releasing these models publicly, PLLuM aims to foster open research and strengthen sovereign AI technologies in Poland.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
