PASCAL: A Phase-Aware Scheduling Algorithm for Serving Reasoning-based Large Language Models
PASCAL:一种面向推理型大语言模型的服务调度算法
机构 * KAIST(韩国科学技术院)
AI总结 PASCAL通过优先处理推理阶段和控制回答阶段的令牌节奏,有效降低了推理型大语言模型的TTFT并保持服务等级目标。
Comments Accepted for publication at the 32nd IEEE International Symposium on High-Performance Computer Architecture (HPCA-32), 2026