PASCAL: A Phase-Aware Scheduling Algorithm for Serving Reasoning-based Large Language Models
PASCAL:一种面向推理型大语言模型的服务调度算法
机构 * KAIST(韩国科学技术院)
专题命中 其他推理 :reasoning(title,abstract);chain-of-thought(abstract);CoT(abstract);分类 cs.LG
AI总结 PASCAL通过优先处理推理阶段和控制回答阶段的令牌节奏,有效降低了推理型大语言模型的TTFT并保持服务等级目标。
Comments Accepted for publication at the 32nd IEEE International Symposium on High-Performance Computer Architecture (HPCA-32), 2026