机构
*
Grainger College of Engineering, Department of Civil and Environmental Engineering, University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校格拉inger工程学院土木与环境工程系)
Rethinking Heterogeneous LLM Merging: A Weighted Model Averaging Perspective
重新思考异构语言模型合并:加权模型平均视角
Jiahe Fan, Yinghao Hou, Si Chen, Aiyuan Zhang, Hong Xie, Defu Lian
机构
*
University of Science and Technology of China(中国科学技术大学)
;
School of Computer Science and Technology, University of Science and Technology of China(中国科学技术大学计算机科学与技术学院)
机构
*
Shanghai AI Laboratory(上海人工智能实验室)
;
MMLab, The Chinese University of Hong Kong(香港中文大学多媒体实验室)
;
Shanghai Jiao Tong University(上海交通大学)
;
Great Bay University(大湾区大学)
CommentsUpdate to the latest ACLpublished version and add a link to the released code
Journal refProceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Association for Computational Linguistics, 2026, pp. 16764-16781