arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2511.16664cs.CL
收藏

Nemotron弹性:迈向高效多任务推理LLM

Nemotron Elastic: Towards Efficient Many-in-One Reasoning LLMs

Ali Taghibakhshi, Sharath Turuvekere Sreenivas, Saurav Muralidharan, Ruisi Cai, Marcin Chochowski, Ameya Sunil Mahabaleshwarkar, Yoshi Suhara, Oluwatobi Olabiyi… 展开作者

Ali Taghibakhshi, Sharath Turuvekere Sreenivas, Saurav Muralidharan, Ruisi Cai, Marcin Chochowski, Ameya Sunil Mahabaleshwarkar, Yoshi Suhara, Oluwatobi Olabiyi, Daniel Korzekwa, Mostofa Patwary, Mohammad Shoeybi, Jan Kautz, Bryan Catanzaro, Ashwath Aithal, Nima Tajbakhsh, Pavlo Molchanov

AI总结:

Nemotron弹性通过嵌套子模型和多预算优化,实现高效多任务推理LLM,显著降低训练成本并提升部署效率。

摘要:

训练一系列针对多个尺度和部署目标的大型语言模型成本过高,需要为每种不同的大小进行单独的训练。最近通过剪枝和知识蒸馏进行模型压缩的工作已降低了这种成本;然而,这一过程仍需要为每个压缩模型花费数百十亿个标记的训练成本。在本文中,我们提出了Nemotron弹性,一种构建以推理为导向的LLM的框架,包括混合Mamba-注意力架构,这些架构在单一父模型中嵌入多个嵌套子模型,每个子模型都针对不同的部署配置和预算进行优化。这些子模型与父模型共享权重,并且可以在部署过程中无需额外训练或微调即可提取。我们通过端到端训练的路由器实现了这一功能,该路由器紧密耦合于专门针对推理模型设计的两阶段训练课程。我们还引入了组感知的SSM弹性化,以保持Mamba的结构约束,异构MLP弹性化,基于归一化MSE的层重要性以改进深度选择,以及知识蒸馏,以实现同时多预算优化。我们应用Nemotron弹性到Nemotron Nano V2 12B模型,同时仅使用110B训练标记生成了一个9B和一个6B模型;这与从头训练模型家族相比,成本减少了超过360倍,与最先进的压缩技术相比,成本减少了约7倍。每个嵌套模型在准确性上与最先进的技术持平或更好。此外,与其他压缩方法不同,我们的方法的嵌套能力允许拥有一个具有恒定部署内存的多任务推理模型,内存与家族中的模型数量无关。

英文摘要:

Training a family of large language models targeting multiple scales and deployment objectives is prohibitively expensive, requiring separate training runs for each different size. Recent work on model compression through pruning and knowledge distillation has reduced this cost; however, this process still incurs hundreds of billions of tokens worth of training cost per compressed model. In this paper, we present Nemotron Elastic, a framework for building reasoning-oriented LLMs, including hybrid Mamba-Attention architectures, that embed multiple nested submodels within a single parent model, each optimized for different deployment configurations and budgets. Each of these submodels shares weights with the parent model and can be extracted zero-shot during deployment without additional training or fine-tuning. We enable this functionality through an end-to-end trained router, tightly coupled to a two-stage training curriculum designed specifically for reasoning models. We additionally introduce group-aware SSM elastification that preserves Mamba's structural constraints, heterogeneous MLP elastification, normalized MSE-based layer importance for improved depth selection, and knowledge distillation enabling simultaneous multi-budget optimization. We apply Nemotron Elastic to the Nemotron Nano V2 12B model, simultaneously producing a 9B and a 6B model using only 110B training tokens; this results in over 360x cost reduction compared to training model families from scratch, and around 7x compared to SoTA compression techniques. Each of the nested models performs on par or better than the SoTA in accuracy. Moreover, unlike other compression methods, the nested capability of our approach allows having a many-in-one reasoning model that has constant deployment memory against the number of models in the family.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑