arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.13367cs.AIcs.CL
收藏

纳贝格4.1-3B:一个小型通用模型,能够推理、对齐和行动

Nanbeige4.1-3B: A Small General Model that Reasons, Aligns, and Acts

Nanbeige LLM Lab(纳贝geist 语言模型实验室)

Chen Yang, Guangyue Peng, Jiaying Zhu, Ran Le, Ruixiang Feng, Tao Zhang, Xiyun Xu, Yang Song, Yiming Jia, Yuntao Wen, Yunzhi Xu, Zekai Wang, Zhenwei An, Zhicong Sun, Zongchao Chen

AI总结:

Nanbeige4.1-3B是一款小型通用模型,通过结合奖励建模和复杂性感知奖励,实现了强大的推理、代码生成和代理行为,展示了3B参数模型的广泛能力与专业性。

摘要:

我们介绍了Nanbeige4.1-3B,一个统一的通用语言模型,仅使用3B参数即可同时实现强大的代理行为、代码生成和一般推理。据我们所知,这是首个开源的小型语言模型(SLM),在单一模型中实现了如此多样的能力。为了提高推理和偏好对齐,我们结合了点状和成对奖励建模,确保高质量的人类对齐响应。对于代码生成,我们设计了复杂性感知的奖励,在强化学习中优化正确性和效率。在深度搜索中,我们进行复杂的数据显示合成,并在训练中纳入回合级监督。这使Nanbeige4.1-3B能够实现稳定的长周期工具交互,使其能够可靠地执行多达600次工具调用回合以解决复杂问题。广泛的实验结果表明,Nanbeige4.1-3B在与之相似规模的先前模型,如Nanbeige4-3B-2511和Qwen3-4B相比,表现显著优于,甚至在比它大得多的模型,如Qwen3-30B-A3B中也表现更优。我们的结果证明,小型模型可以同时实现广泛的通用能力和强大的专业能力,重新定义了3B参数模型的潜力。

英文摘要:

We present Nanbeige4.1-3B, a unified generalist language model that simultaneously achieves strong agentic behavior, code generation, and general reasoning with only 3B parameters. To the best of our knowledge, it is the first open-source small language model (SLM) to achieve such versatility in a single model. To improve reasoning and preference alignment, we combine point-wise and pair-wise reward modeling, ensuring high-quality, human-aligned responses. For code generation, we design complexity-aware rewards in Reinforcement Learning, optimizing both correctness and efficiency. In deep search, we perform complex data synthesis and incorporate turn-level supervision during training. This enables stable long-horizon tool interactions, allowing Nanbeige4.1-3B to reliably execute up to 600 tool-call turns for complex problem-solving. Extensive experimental results show that Nanbeige4.1-3B significantly outperforms prior models of similar scale, such as Nanbeige4-3B-2511 and Qwen3-4B, even achieving superior performance compared to much larger models, such as Qwen3-30B-A3B. Our results demonstrate that small models can achieve both broad competence and strong specialization simultaneously, redefining the potential of 3B parameter models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑