DynaSpec: Context-aware Dynamic Speculative Sampling for Large-Vocabulary Language Models
DynaSpec: 一种基于上下文的动态推测采样方法用于大词汇量语言模型
Jinbin Zhang, Nasib Ullah, Erik Schultheis, Rohit Babbar
机构
*
Department of Computer Science(计算机科学系)
;
Aalto University(阿alto大学)
;
Deep Algorithms and Systems Lab(深度算法与系统实验室)
;
IST Austria(IST奥地利研究院)
;
University of Bath(巴斯大学)
From Deferral to Learning: Online In-Context Knowledge Distillation for LLM Cascades
从延迟到学习:在线上下文知识蒸馏用于LLM级联
Yu Wu, Shuo Wu, Ye Tao, Yansong Li, Anand D. Sarwate
机构
*
Department of XXX, University of YYY, Location, Country(XXX系,YYY大学,地点,国家)
;
School of ZZZ, Institute of WWW, Location, Country(ZZZ学院,WWW研究所,地点,国家)
;
Department of Electrical and Computer Engineering, Rutgers University, NJ, USA(电气与计算机工程系,Rutgers大学,新泽西州,美国)
;
Computer Engineering Department, University of Illinois Chicago, Illinois, USA(计算机工程系,伊利诺伊大学芝加哥分校,伊利诺伊州,美国)
SpecFLASH: A Latent-Guided Semi-autoregressive Speculative Decoding Framework for Efficient Multimodal Generation
SpecFLASH: 一种基于潜在引导的半自回归推测解码框架,用于高效多模态生成
Zihua Wang, Ruibo Li, Haozhe Du, Joey Tianyi Zhou, Yu Zhang, Xu Yang
机构
*
Southeast University, Nanjing, China(东南大学)
;
Nanyang Technological University, Singapore(南洋理工大学)
;
A STAR Centre for Frontier AI Research (CFAR), Singapore(A STAR前沿人工智能研究中心)
专题命中
效率与部署
:LLM(abstract);large language model(abstract);language model(abstract);instruction tuning(abstract)
机构
*
School of Science and Engineering, The Chinese University of Hong Kong, Shenzhen(科学与工程学院,香港中文大学(深圳))
;
Shenzhen Future Network of Intelligence Institute(深圳未来网络智能研究院)
;
Wangxuan Institute of Computer Technology, Peking University(王轩计算机技术研究所,北京大学)
机构
*
Penn State University(宾夕法尼亚州立大学)
;
University at Buffalo(布法罗大学)
;
University of Washington(华盛顿大学)
;
The University of Hong Kong(香港大学)
;
City University of Hong Kong(城市大学)
;
Alibaba Group(阿里巴巴集团)
;
Allen Institute for AI (AI2)(人工智能研究所(AI2))
ToolTok: Tool Tokenization for Efficient and Generalizable GUI Agents
ToolTok: 为高效且通用的GUI代理的工具标记化
Xiaoce Wang, Guibin Zhang, Junzhe Li, Jinzhe Tu, Chun Li, Ming Li
机构
*
Department of Computer Science, Tsinghua University, Beijing, China(清华大学计算机科学系)
;
Guangming Laboratory, Shenzhen, China(光明实验室)
;
National University of Singapore, Singapore(新加坡国立大学)
;
Peking University, Beijing, China(北京大学)
;
MSU-BIT-SMBU Joint Research Center of Applied Mathematics, Shenzhen MSU–BIT University(MSU-BIT-SMBU应用数学联合研究中心)
专题命中
效率与部署
:large language model(abstract);language model(abstract);post-training(abstract);分类 cs.AI、cs.LG
Semantic Routing: Exploring Multi-Layer LLM Feature Weighting for Diffusion Transformers
语义路由:探索多层LLM特征加权用于扩散变换器
Bozhou Li, Yushuo Guan, Haolin Li, Bohan Zeng, Yiyan Ji, Yue Ding, Pengfei Wan, Kun Gai, Yuanxing Zhang, Wentao Zhang
机构
*
Peking University(北京大学)
;
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
;
Nanjing University(南京大学)
;
Fudan University(复旦大学)
机构
*
AutoLab, School of Artificial Intelligence, Shanghai Jiao Tong University(自动化实验室,人工智能学院,上海交通大学)
;
Anyverse Dynamics
;
State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences(多模态人工智能系统国家重点实验室,自动化研究所,中国科学院)
;
School of Artificial Intelligence, University of Chinese Academy of Sciences(人工智能学院,中国科学院大学)
;
Terminal Technology Department, Alipay, Ant Group(终端技术部,蚂蚁集团)
专题命中
效率与部署
:LLM(abstract);large language model(abstract);language model(abstract)