The inference cost of Large Language Models (LLMs) has become a critical factor in determining their commercial viability and widespread adoption. This paper introduces a quantitative ``economics of inference'' framework, treating the LLM inference process as a compute-driven intelligent production activity. We analyze its marginal cost, economies of scale, and quality of output under various performance configurations. Based on empirical data from WiNEval-3.0, we construct the first ``LLM Inference Production Frontier,'' revealing three principles: diminishing marginal cost, diminishing returns to scale, and an optimal cost-effectiveness zone. This paper not only provides an economic basis for model deployment decisions but also lays an empirical foundation for the future market-based pricing and optimization of AI inference resources.
Computational Challenges in Token Economics: Bridging Economic Theory and AI System Design
Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences(中国科学院大学杭州高等研究院);Hefei Institutes of Physical Science, Chinese Academy of Sciences(中国科学院合肥物理研究所)
Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
School of Computer Science, Fudan University(复旦大学计算机科学学院);School of Computer Science and Technology, East China Normal University(华东师范大学计算机科学与技术学院);Institute of Modern Languages and Linguistics, Fudan University(复旦大学现代语言与语言学研究所);Institute of Trustworthy Embodied Artificial Intelligence, Fudan University(复旦大学可信具身人工智能研究所);Shanghai Collaborative Innovation Center of Intelligent Visual Computing(上海智能视觉计算协同创新中心);Pengcheng Laboratory(鹏城实验室);Hikvision Inc(海康威视公司)
Beyond Ethics: How Inclusive Innovation Drives Economic Returns in Medical AI
Department of Computer Science, University of Toronto(多伦多大学计算机科学系);Bordeaux Population Health Research Center, University of Bordeaux(波尔多大学人口健康研究中心);Faculty of Pharmaceutical Sciences, University of British Columbia(不列颠哥伦比亚大学药学系);Synthesize Health, Canada(加拿大Synthesize Health公司);Computing and Mathematical Sciences, California Institute of Technology(加州理工学院计算与数学科学系);RAND Corporation(RAND公司);Department of Radiology and Radiotherapy, Makerere University(Makerere大学放射科与放射治疗系);Laboratory for Computational Physiology, Massachusetts Institute of Technology(麻省理工学院计算生理学实验室);Department of Bioengineering, Instituto Superior Técnico(葡萄牙 Instituto Superior Técnico 生物工程系);Oak Ridge National Laboratory(橡树岭国家实验室);Institute of Psychiatry, Psychology & Neuroscience, King’s College London(伦敦国王学院精神病学、心理学与神经科学研究所);School of Population and Public Health, University of British Columbia(不列颠哥伦比亚大学流行病学与公共卫生学院);Provincial Health Services Authority, British Columbia, Canada(不列颠哥伦比亚省卫生服务局);Division of Pulmonary, Critical Care and Sleep Medicine, Beth Israel Deaconess Medical Center(Beth Israel Deaconess 医疗中心呼吸科、重症医学与睡眠医学科);Department of Biostatistics, Harvard T.H. Chan School of Public Health(哈佛大学T.H. 潘菲尔德公共卫生学院生物统计学系)
Memory Scarcity, Open Models, and the Restructuring of the AI Industry, 2026-2030 -- A quantitative scenario analysis of inference economics, training-cost divergence, and infrastructure solvency
RIKEN Center for Computational Science (R-CCS)(日本理化学研究所计算科学中心)
Economics of Human and AI Collaboration: When is Partial Automation More Attractive than Full Automation?
Massachusetts Institute of Technology(麻省理工学院);École Polytechnique Fédérale de Lausanne(洛桑联邦理工学院);IBM Research(IBM研究院);IBM’s Institute for Business Value(IBM商业价值研究院)