CAST: Continuous and Differentiable Semi-Structured Sparsity-Aware Training for Large Language Models
Weiyu Huang, Yuezhou Hu, Jun Zhu, Jianfei Chen
机构
*
Department of Computer Science and Technology, Institute for AI, BNRist Center, THBI Lab, Tsinghua-Bosch Joint ML Center, Tsinghua University(计算机科学与技术系、人工智能研究院、BNRist中心、THBI实验室、清华大学-博世联合机器学习中心、清华大学)
专题命中
效率与部署
:large language model(title,abstract);language model(title,abstract);pretraining(abstract);分类 cs.CL、cs.LG
Conda: Column-Normalized Adam for Training Large Language Models Faster
Junjie Wang, Pan Zhou, Yiming Dong, Huan Li, Jia Li, Xun Zhou, Qicheng Lao, Cong Fang, Zhouchen Lin
机构
*
State Key Lab of General AI, School of Intelligence Science and Technology, Peking University(通用人工智能国家重点实验室,智能科学与技术学院,北京大学)
;
Singapore Management University(新加坡国立大学)
;
Nankai University(南开大学)
;
Beijing Normal University(北京师范大学)
;
ByteDance Seed(字节跳动种子)
;
Beijing University of Posts and Telecommunications(北京邮电大学)
;
Institute for Artificial Intelligence, Peking University(人工智能研究院,北京大学)
;
Pazhou Laboratory (Huangpu), Guangzhou, Guangdong, China(黄埔实验室(广州),广东,中国)
专题命中
效率与部署
:large language model(title,abstract);language model(title,abstract);LLM(abstract);分类 cs.AI、cs.LG
机构
*
Department of Automation, Tsinghua University(自动化系,清华大学)
;
Beijing National Research Center for Information Science and Technology(北京信息科学与技术国家研究中心)
专题命中
效率与部署
:large language model(title,abstract);language model(title,abstract);LLM(abstract);分类 cs.CL、cs.AI
SparseDoctor: Towards Efficient Chat Doctor with Mixture of Experts Enhanced Large Language Models
Jianbin Zhang, Yulin Zhu, Wai Lun Lo, Richard Tai-Chiu Hsung, Harris Sik-Ho Tsang, Kai Zhou
机构
*
Department of Computer Science, Hong Kong Chu Hai College(香港 Chu Hai 学院计算机科学系)
;
Department of Computing, The Hong Kong Polytechnic University(香港理工大学计算机系)
专题命中
效率与部署
:large language model(title,abstract);language model(title,abstract);LLM(abstract);分类 cs.CL、cs.AI
机构
*
School of Computer Science and Information Engineering, Hefei University of Technology(合肥工业大学计算机科学与信息工程学院)
;
College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院)
;
College of Cyber Security, Jinan University(暨南大学网络安全学院)
专题命中
效率与部署
:large language model(title,abstract);language model(title,abstract);LLM(abstract);分类 cs.CL、cs.AI
Yet another algorithmic bias: A Discursive Analysis of Large Language Models Reinforcing Dominant Discourses on Gender and Race
Gustavo Bonil, Simone Hashiguti, Jhessica Silva, João Gondim, Helena Maia, Nádia Silva, Helio Pedrini, Sandra Avila
机构
*
Instituto de Estudos da Linguagem (IEL), Universidade Estadual de Campinas (UNICAMP)(语言研究学院(IEL),Campinas州立大学(UNICAMP))
;
Instituto de Computação (IC), Universidade Estadual de Campinas (UNICAMP)(计算学院(IC),Campinas州立大学(UNICAMP))
;
Instituto de Informática, Universidade Federal de Goiás (UFG)(信息学院,戈亚斯联邦大学(UFG))
专题命中
效率与部署
:large language model(title,abstract);language model(title,abstract);LLM(abstract);分类 cs.CL、cs.AI