TailSieve: Partial-Rollout-Guided Tail Routing for LLM Rollouts
TailSieve:面向大语言模型(LLM)rollout的部分rollout引导式长尾路由
Tianqi Xu, Lu Lv, Haoyang Huang, Wenjie Huang, Zhanming Shen, Yuhao Shen, Baolin Zhang, Xinyi Hu, Shuang Ge, Jun Dai, Tianyu Liu, Suorong Yang, Zhikai Li, Ye Bai, Jun Zhang, Lei Chen, Yue Li, Mingchen Wan
机构
*
Qwen Business Unit of Alibaba(阿里巴巴通义千问业务部)
;
Carnegie Mellon University(卡内基梅隆大学)
;
Zhejiang University(浙江大学)
;
University of Science and Technology of China(中国科学技术大学)
;
National University of Singapore(新加坡国立大学)
;
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
机构
*
Sun Yat-sen University(中山大学)
;
Shanghai Jiao Tong University(上海交通大学)
;
University of Electronic Science and Technology of China(电子科技大学)
;
Alibaba Group(阿里巴巴集团)
;
Shanghai University(上海大学)