面向AI基础设施的统一度量架构:整合性能、效率和成本的跨层分类
A Unified Metric Architecture for AI Infrastructure: A Cross-Layer Taxonomy Integrating Performance, Efficiency, and Cost
AI总结:
本文提出统一度量架构,整合性能、效率和成本,通过跨层分类和分解,建立6x3分类学以优化AI基础设施的多目标优化。
摘要:
大规模AI系统的增长日益受到基础设施限制的制约:电力供应、热能和水资源限制、互连扩展、内存压力、数据管道吞吐量以及快速上升的生命周期成本。在超大规模集群中,这些限制相互作用,但主要的度量标准仍然碎片化。现有的度量标准,从设施度量(PUE)和机架功率密度到网络度量(all-reduce延迟)、数据管道度量和财务度量(TCO系列),每种只捕捉其自身领域的内容,无法提供物理、计算和经济限制如何相互作用的综合视图。这种碎片化模糊了能源、计算和成本之间的结构关系,阻碍了跨领域的协调优化,以及瓶颈如何产生、传播和共同决定AI基础设施效率前沿的识别。本文开发了一个整合框架,通过三个领域的语义分类和六层架构分解,产生一个6x3的分类学,映射各种领域如何在AI基础设施栈中传播。该分类学基于对所有具有经济和财务相关性的度量标准的系统回顾和元分析,识别了最广泛使用的度量标准、其研究强度以及跨领域依赖关系。在此证据基础上,度量传播图(MPG)正式化了跨层依赖关系,使系统层面的解释、复合度量标准的构建以及能量、碳和成本的多目标优化成为可能。该框架通过将物理操作、计算效率和成本结果连接到统一的分析结构中,为基准测试、集群设计、容量规划和生命周期经济分析提供了连贯的基础。
英文摘要:
The growth of large-scale AI systems is increasingly constrained by infrastructure limits: power availability, thermal and water constraints, interconnect scaling, memory pressure, data-pipeline throughput, and rapidly escalating lifecycle cost. Across hyperscale clusters, these constraints interact, yet the main metrics remain fragmented. Existing metrics, ranging from facility measures (PUE) and rack power density to network metrics (all-reduce latency), data-pipeline measures, and financial metrics (TCO series), each capture only their own domain and provide no integrated view of how physical, computational, and economic constraints interact. This fragmentation obscures the structural relationships among energy, computation, and cost, preventing a coherent optimization across sector and how bottlenecks emerge, propagate, and jointly determine the efficiency frontier of AI infrastructure. This paper develops an integrated framework that unifies these disparate metrics through a three-domain semantic classification and a six-layer architectural decomposition, producing a 6x3 taxonomy that maps how various sectors propagate across the AI infrastructure stack. The taxonomy is grounded in a systematic review and meta-analysis of all metrics with economic and financial relevance, identifying the most widely used measures, their research intensity, and their cross-domain interdependencies. Building on this evidence base, the Metric Propagation Graph (MPG) formalizes cross-layer dependencies, enabling systemwide interpretation, composite-metric construction, and multi-objective optimization of energy, carbon, and cost. The framework offers a coherent foundation for benchmarking, cluster design, capacity planning, and lifecycle economic analysis by linking physical operations, computational efficiency, and cost outcomes within a unified analytic structure.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。