LLM推理服务：近期进展与机遇综述
LLM Inference Serving: Survey of Recent Advances and Opportunities
AI总结：
本综述系统梳理了2023年以来LLM服务系统在系统级优化方面的进展，涵盖性能提升与效率改进，为生产环境部署提供实践指导。
摘要：
本综述全面概述了大型语言模型（LLM）服务系统的最新进展，重点关注自2023年以来的研究。我们专门考察了在不改变核心LLM解码机制的情况下提升性能和效率的系统级增强。通过从顶级机器学习和系统会议中精选高质量论文，我们强调了在真实生产环境中部署和扩展LLM的关键创新与实践考量。本综述为希望紧跟这一快速演进领域最新发展的LLM从业者提供了宝贵资源。
英文摘要：
This survey offers a comprehensive overview of recent advancements in Large Language Model (LLM) serving systems, focusing on research since the year 2023. We specifically examine system-level enhancements that improve performance and efficiency without altering the core LLM decoding mechanisms. By selecting and reviewing high-quality papers from prestigious ML and system venues, we highlight key innovations and practical considerations for deploying and scaling LLMs in real-world production environments. This survey serves as a valuable resource for LLM practitioners seeking to stay abreast of the latest developments in this rapidly evolving field.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
