GuiLoMo: Allocating Expert Number and Rank for LoRA-MoE via Bilevel Optimization with GuidedSelection Vectors
机构 * The University of Hong Kong(香港大学) ; Peking University(北京大学) ; Beijing University of Posts and Telecommunications(北京邮电大学) ; University of California, Los Angeles(加州大学洛杉矶分校) ; National Science Library, Chinese Academy of Sciences(中国科学院国家科学图书馆)
Comments Accepted by EMNLP 2025