Comet: Accelerating Private Inference for Large Language Model by Predicting Activation Sparsity
机构 * State Key Laboratory of Cyberspace Security Defense, Institute of Information Engineering, CAS and University of Chinese Academy of Sciences(国家密码安全防御重点实验室,信息工程研究所,中国科学院及中国科学院大学) ; EIRI, NELBDRC, Tsinghua University(EIRI,NELBDRC,清华大学)
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);LLM(abstract);分类 cs.AI
Comments Accepted to SP 2025