Reasoning Language Model Inference Serving Unveiled: An Empirical Study
机构 * The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州)) ; Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院) ; HKBU(香港 Baptist University) ; University of Wisconsin-Madison(威斯康星大学麦迪逊分校) ; Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳)) ; The Hong Kong University of Science and Technology(香港科学与技术大学)