MoSE: Mixture of Slimmable Experts for Efficient and Adaptive Language Models
MoSE: 混合可瘦身专家实现高效自适应语言模型
Nurbek Tastan, Stefanos Laskaridis, Karthik Nandakumar, Samuel Horvath
机构
*
Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), UAE(Mohamed bin Zayed人工智能大学(MBZUAI))
;
Michigan State University (MSU), USA(密歇根州立大学(MSU))
;
Amazon Science, UK(亚马逊科学)