arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2510.26136cs.AI
收藏

超越基准:AI推理的经济学

Beyond Benchmarks: The Economics of AI Inference

WiNGPT Team(WiNGPT团队)

Boqin Zhuang, Jiacheng Qiao, Mingqian Liu, Mingxing Yu, Ping Hong, Rui Li, Xiaoxia Song, Xiangjun Xu, Xu Chen, Yaoyao Ma, Yujie Gao

摘要:

大语言模型(LLM)的推理成本已经成为决定其商业可行性和广泛采用的关键因素。本文介绍了一个定量的“推理经济学”的框架,把LLM推理过程作为一个计算机驱动的智能生产活动。我们分析了其边际成本,规模经济,并在各种性能配置的输出质量。基于WiNEval-3.0的经验数据,我们构建了第一个“LLM推理生产前沿”,揭示了三个原则:边际成本递减,规模收益递减和最佳成本效益区。本文不仅为模型部署决策提供了经济依据,也为未来人工智能推理资源的市场化定价和优化奠定了实证基础。

英文摘要:

The inference cost of Large Language Models (LLMs) has become a critical factor in determining their commercial viability and widespread adoption. This paper introduces a quantitative ``economics of inference'' framework, treating the LLM inference process as a compute-driven intelligent production activity. We analyze its marginal cost, economies of scale, and quality of output under various performance configurations. Based on empirical data from WiNEval-3.0, we construct the first ``LLM Inference Production Frontier,'' revealing three principles: diminishing marginal cost, diminishing returns to scale, and an optimal cost-effectiveness zone. This paper not only provides an economic basis for model deployment decisions but also lays an empirical foundation for the future market-based pricing and optimization of AI inference resources.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑