EasyOPD: An Easy-to-use On-Policy Distillation Framework for Large Language Models
EasyOPD:一种易于使用的大语言模型在线策略蒸馏框架
Jie Sun, Mao Zheng, Mingyang Song, Qiyong Zhong, Gengsheng Li, Zhepei Hong, Chang Wu, Pengfei Liu, Junfeng Fang, Xiang Wang
机构
*
University of Science and Technology of China(中国科学技术大学)
;
Tencent(腾讯)
;
Shanghai Innovation Institute(上海创新研究院)
;
National University of Singapore(新加坡国立大学)
机构
*
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
;
University of Chinese Academy of Sciences(中国科学院大学)
;
Tencent Hunyuan(腾讯混元)
;
HKUST(香港科技大学)
;
Beijing Key Laboratory of Super Intelligent Security of Multi-Modal Information(多模态信息超智能安全北京重点实验室)
;
School of Information Science and Technology, ShanghaiTech University(上海科技大学信息科学与技术学院)
机构
*
Tencent(腾讯)
;
University of Maryland, College Park(马里兰大学帕克分校)
;
University of Georgia(佐治亚大学)
;
University of Minnesota, Twin Cities(明尼苏达大学双城分校)
;
Indiana University(印第安纳大学)
;
Lehigh University(里海大学)
;
National University of Singapore(新加坡国立大学)
;
The Hong Kong Polytechnic University(香港理工大学)
机构
*
Analemma
;
National University of Singapore(新加坡国立大学)
;
Fudan University(复旦大学)
;
University College Dublin(都柏林大学)
;
Washington University in St. Louis(圣路易斯华盛顿大学)
;
The Hong Kong University of Science and Technology(香港科技大学)
;
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
;
University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
;
ByteDance(字节跳动)
;
ShanghaiTech University(上海科技大学)
;
University of Warwick(华威大学)
;
Carnegie Mellon University(卡内基梅隆大学)
;
University of Michigan, Ann Arbor(密歇根大学安娜堡分校)
;
East China Normal University(华东师范大学)
;
Stanford University(斯坦福大学)
;
Tencent(腾讯)
;
The University of Hong Kong(香港大学)
;
Shanghai Innovation Institute(上海创新研究院)
;
Nex-AGI Team(Nex-AGI团队)
机构
*
Department of Computer Science and Engineering, The Hong Kong University of Science and Technology (HKUST), Hong Kong SAR, China(香港科技大学计算机科学与工程系)
;
Tencent, Shenzhen, China(腾讯(中国深圳))
;
Shenzhen Institute of Advanced Technology (SIAT), Chinese Academy of Sciences, Shenzhen, China(深圳先进技术研究所(SIAT),中国科学院)