MLSYSIM:用于机器学习系统的第一性原理基础设施建模
MLSYSIM: First-Principles Infrastructure Modeling for Machine Learning Systems
AI总结:
研究机器学习系统基础设施建模问题,提出MLSYSIM框架,基于供需抽象,通过可组合模型和求解器,实现亚秒级设计空间探索,确定约束并合成硬件规格。
摘要:
随着机器学习从实验室走向关键基础设施,其支撑系统范围广泛。经验分析需实际硬件,精确模拟耗时久。我们提出MLSYSIM,将系统“物理”形式化为严格的Python引擎,基于供需抽象,运行时保证单元完整性,可实现亚秒级设计空间探索。
英文摘要:
As machine learning shifts from laboratory curiosity to critical infrastructure, the systems that sustain it span an extraordinary range, from sub-milliwatt microcontrollers to multi-gigawatt datacenter fleets. Reasoning across this range is hard: empirical profiling requires the target hardware in hand, while cycle-accurate simulation costs hours per configuration, leaving no tool for rapid, full-stack architectural reasoning. We present MLSYSIM (Machine Learning Systems Infrastructure Modeling), a first-principles analytical framework that formalizes the "physics of systems" into a dimensionally-strict Python engine. MLSysim is built on a demand-supply abstraction that decouples computational demand from silicon supply and environmental context, and it enforces unit integrity at runtime so the silent conversion errors that plague ad-hoc modeling cannot occur. Every input is drawn from a typed, provenance-tracked registry, so no number enters an analysis without a documented source. On this engine we codify a taxonomy of 22 "Systems Walls" resolved by 28 composable models and solvers, enabling sub-second design-space exploration that identifies binding constraints and synthesizes ideal hardware specifications across the entire ML systems lifecycle.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。