Analytical Provisioning for Attention-FFN Disaggregated LLM Serving under Stochastic Workloads
注意力-前馈网络解耦大语言模型服务的分析资源配置
Chendong Song, Meixuan Wang, Hang Zhou, Hong Liang, Yuan Lyu, Zixi Chen, Yuwei Fan, Zijie Zhou
机构
*
Dept. of Industrial Engineering and Decision Analytics HKUST(工业工程与决策分析系香港科技大学)
;
Dept. of Computer Science and Technology Tsinghua University(计算机科学与技术系清华大学)
;
IIIS Tsinghua University(清华大学信息学院)
;
Huawei Hong Kong Research Center(华为香港研发中心)
;
School of Mathematical Sciences Peking University(北京大学数学科学学院)
SAFE-SVD: Sensitivity-Aware Fidelity-Enforcing SVD for Physics Foundation Models
SAFE-SVD:面向物理基础模型的敏感性感知保真度压缩SVD
Chengjie Hong, Feixiang He, Yiheng Zeng, Lulu Kang, He Wang
机构
*
AI Centre, University College London(伦敦大学学院人工智能中心)
;
University College London(伦敦大学学院)
;
Central South University(中南大学)
;
University of Massachusetts at Amherst(马萨诸塞大学阿姆赫斯特分校)
Depth-adaptive Inference of Looped Language Models via Continuous Depth Batching
基于连续深度批处理的循环语言模型深度自适应推理
Kristian Schwethelm, Daniel Rueckert, Georgios Kaissis
机构
*
Technical University of Munich (TUM)(慕尼黑工业大学(TUM))
;
Imperial College London(帝国理工学院)
;
Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心)
;
University of Potsdam(波茨坦大学)
;
Hasso Plattner Institute for Digital Engineering(哈索·普拉特纳数字工程研究所)
Explaining, Verifying, and Aligning Semantic Hierarchies in Vision-Language Model Embeddings
解释、验证和对齐视觉语言模型嵌入中的语义层次结构
Gesina Schwalbe, Mert Keser, Moritz Bayerkuhnlein, Edgar Heinert, Annika Mütze, Marvin Keller, Sparsh Tiwari, Georgii Mikriukov, Diedrich Wolter, Jae Hee Lee, Matthias Rottmann
机构
*
University of Lübeck(吕贝克大学)
;
Technical University of Munich(慕尼黑工业大学)
;
AUMOVIO SE
;
Osnabrück University(奥斯纳布吕克大学)
;
Leibniz Institute for Agricultural Engineering and Bioeconomy(莱布尼茨农业工程与生物经济研究所)
;
University of Hamburg(汉堡大学)
Estimating Tail Risks in Language Model Output Distributions
语言模型输出分布中的尾部风险估计
Rico Angell, Raghav Singhal, Zachary Horvitz, Zhou Yu, Rajesh Ranganath, Kathleen McKeown, He He
机构
*
Columbia University(哥伦比亚大学)
;
Department of Computer Science, New York University(纽约大学计算机科学系)
;
Center for Data Science, New York University(纽约大学数据科学中心)
Expert-Choice Routing Enables Adaptive Computation in Diffusion Language Models
专家选择路由使扩散语言模型实现自适应计算
Shuibai Zhang, Caspian Zhuang, Chihan Cui, Zhihan Yang, Fred Zhangzhi Peng, Yanxin Zhang, Haoyue Bai, Zack Jia, Yang Zhou, Guanhua Chen, Ming Liu
机构
*
University of Wisconsin-Madison(威斯康星大学麦迪逊分校)
;
Scitix
;
Cornell University(康奈尔大学)
;
Duke University(杜克大学)
;
UC Davis(加州大学戴维斯分校)
;
Southern University of Science and Technology(南方科技大学)
Atlas 2 -- Foundation models for clinical deployment
Atlas 2 -- 临床应用的基础模型
Maximilian Alber, Timo Milbich, Alexandra Carpen-Amarie, Stephan Tietz, Jonas Dippel, Lukas Muttenthaler, Beatriz Perez Cancer, Alessandro Benetti, Panos Korfiatis, Elias Eulig, Jérôme Lüscher, Jiasen Wu, Sayed Abid Hashimi, Gabriel Dernbach, Simon Schallenberg, Neelay Shah, Moritz Krügener, Aniruddh Jammoria, Jake Matras, Patrick Duffy, Matt Redlon, Philipp Jurmeister, David Horst, Lukas Ruff, Klaus-Robert Müller, Frederick Klauschen, Andrew Norgan
机构
*
Aignostics, Germany(德国Aignostics公司)
;
Department of Laboratory Medicine and Pathology, Mayo Clinic, Rochester, MN, US(美国梅奥诊所实验室医学与病理学部门)
;
Department of Radiology, Mayo Clinic, Rochester MN, US(美国梅奥诊所放射学部门)
;
Department of Information Technology, Mayo Clinic, Rochester MN, US(美国梅奥诊所信息技术部门)
;
Mayo Clinic, Rochester MN, US(美国梅奥诊所)
;
Digital Pathology, Mayo Clinic, Rochester MN, US(美国梅奥诊所数字病理学部门)
;
Machine Learning Group, Technische Universität Berlin, Germany(德国柏林技术大学机器学习小组)
;
BIFOLD – Berlin Institute for the Foundations of Learning and Data, Germany(德国柏林学习与数据基础研究所)
;
Department of Artificial Intelligence, Korea University, Republic of Korea(韩国韩国大学人工智能系)
;
Max-Planck Institute for Informatics, Germany(德国马克斯·普朗克信息研究所)
;
German Cancer Research Center (DKFZ) & German Cancer Consortium (DKTK), Berlin & Munich Partner Sites, Germany(德国癌症研究中心(DKFZ)及德国癌症联盟(DKTK)柏林与慕尼黑合作站点)
;
Institute of Pathology, Ludwig-Maximilians-Universität München, Germany(德国慕尼黑路德维希-马克西米利安大学病理学研究所)
;
Institute of Pathology, Charité – Universitätsmedizin Berlin, Germany(德国柏林夏里特大学医学中心病理学研究所)
;
Bavarian Cancer Research Center (BZKF), Germany(德国巴伐利亚癌症研究中心(BZKF))
;
Helmholtz Munich, Germany(德国海德堡-慕尼黑亥姆霍兹中心)
;
Technical University Munich, Germany(德国慕尼黑技术大学)