Lazarus: Resilient and Elastic Training of Mixture-of-Experts Models
机构 * UC Berkeley(伯克利大学) ; NUS(新加坡国立大学) ; UMich(密歇根大学) ; AWS(亚马逊云科技) ; NVIDIA(英伟达) ; UCLA(加州大学洛杉矶分校) ; Duke(杜克大学)
高校专区
机构 * UC Berkeley(伯克利大学) ; NUS(新加坡国立大学) ; UMich(密歇根大学) ; AWS(亚马逊云科技) ; NVIDIA(英伟达) ; UCLA(加州大学洛杉矶分校) ; Duke(杜克大学)
机构 * Department of Statistics, UC Riverside(统计学系,加州大学河滨分校) ; Department of Electrical and Computer Engineering, UCLA(电气与计算机工程系,加州大学洛杉矶分校) ; Department of Psychiatry and Biobehavioral Sciences, UCLA(精神病学与生物行为科学系,加州大学洛杉矶分校)
Comments NeurIPS 2025: The Second Workshop on GenAI for Health: Potential, Trust, and Policy Compliance
机构 * Department of Mathematics, University of California, Los Angeles, CA 90095(数学系,加州大学洛杉矶分校) ; Department of Statistics and Applied Probability, University of California, Santa Barbara, CA 93106-3110(统计与应用概率系,加州大学圣巴巴拉分校) ; Department of Mathematics, and Department of Statistics and Applied Probability, University of California, Santa Barbara, CA 93106-3080(数学系,统计与应用概率系,加州大学圣巴巴拉分校)
机构 * Department of Mathematics UCLA(数学系,加州大学洛杉矶分校) ; Oden Institute University of Texas at Austin(奥登研究所,德克萨斯大学奥斯汀分校) ; School of Data Science and Society UNC Chapel Hill(数据科学与社会学院,北卡罗来纳大学夏洛特分校) ; SRI International(SRI国际) ; Department of Mathematics and Statistics University of Massachusetts Amherst(数学与统计系,马萨诸塞大学阿姆赫斯特分校)
机构 * NSF AI Institute for Artificial Intelligence and Fundamental Interactions(NSF人工智能与基础相互作用研究院) ; Massachusetts Institute of Technology(麻省理工学院) ; Polytechnic University of Catalonia(加泰罗尼亚理工大学) ; Harvard University(哈佛大学) ; University of California, Los Angeles(加州大学洛杉矶分校)
Comments 34 pages, 13 figures, 2 tables