Hardware Co-Design Scaling Laws via Roofline Modelling for On-Device LLMs
通过屋顶线建模为设备端大语言模型设计硬件协同缩放定律
Luoyang Sun, Jiwen Jiang, Yifeng Ding, Fengfa Li, Yan Song, Haifeng Zhang, Jian Ying, Lei Ren, Kun Zhan, Wei Chen, Yan Xie, Cheng Deng
机构
*
AI Lab, The Yangtze River Delta Institution of Automation, Chinese Academy of Sciences(人工智能实验室,长江三角洲自动化研究所,中国科学院)
;
University of Chinese Academy of Sciences(中国科学院大学)
;
University College London(伦敦大学学院)
;
Institution of Automation, Chinese Academy of Sciences(自动化研究所,中国科学院)
;
The University of Edinburgh(爱丁堡大学)
Dinesh Wagle, Daniel Stoeffler, Loic Temdie, Mojtaba Taghipour Kaffash, Vincent Castel, H. Majjad, R. Bernard, Yves Henry, Matthieu Bailleul, M. Benjamin Jungfleisch, Vincent Vlaminck