VIA-SD: Verification via Intra-Model Routing for Speculative Decoding
VIA-SD:通过模型内路由进行推测解码的验证
机构 * ReLER, The State Key Lab of Brain Machine Intelligence, Zhejiang University(脑机智能国家重点实验室,浙江大学) ; College of Artificial Intelligence, Zhejiang University(人工智能学院,浙江大学) ; CFAR, Agency for Science, Technology and Research, Singapore(科学与技术研究局,新加坡) ; National University of Singapore(新加坡国立大学)
AI总结 提出VIA-SD多级验证框架,利用从完整验证器派生的精简验证器处理中等置信度令牌,减少大模型调用,在多个任务上实现10-20%加速。
Comments Accepted at the 43rd International Conference on Machine Learning (ICML 2026)