Two Heads are Better than One: Distilling Large Language Model Features Into Small Models with Feature Decomposition and Mixture
双头胜于单头:通过特征分解和混合将大语言模型特征蒸馏到小模型中
机构 * Peking university(北京大学)
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);LLM(abstract);分类 cs.AI
AI总结 本文提出CMM框架,通过特征分解和混合将大语言模型特征蒸馏到小模型中,提升市场做市效率。
Comments accepted by AAAI2026