arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2605.22883cs.AIcs.LGcs.PF
收藏

每个成功目标的能量:面向智能体AI系统的目标级能量核算

Energy per Successful Goal: Goal-Level Energy Accounting for Agentic AI Systems

Independent Researcher(独立研究者);Texas A\&M University(德克萨斯A&M大学);Texas A\&M University Department of Computer Science(德克萨斯A&M大学计算机科学系)

Deepak Panigrahy, Aakash Tyagi, Stephen Abkin, David Kebo Houngninou, Rabi Mahapatra

AI总结:

提出A-LEMS框架,将AI能量核算单位从每次推理能量转换为每个成功目标能量(EpG),并定义编排开销指数(OOI),实验表明智能体工作流平均能耗是线性基线的4.33倍,且能耗主要由编排结构而非推理计算驱动。

摘要:

当前的AI能量基准在单次模型调用或训练运行的粒度上测量能耗。对于经典的单轮工作负载,这种单位仍然一致。但对于智能体系统——其中单个用户目标可能触发多步编排、工具调用、重试和故障恢复循环——调用次数是实现产物而非任务属性,推理级归一化错误地表示了目标完成的能量成本。我们提出A-LEMS(智能体LLM能量测量系统),一个跨层测量框架,将AI能量核算单位从每次推理能量重新定义为每个成功目标能量(EpG)。EpG聚合所有执行尝试(包括失败和重试)的总工作流能量,归一化到成功完成的目标。A-LEMS通过时间边界模型、将RAPL信号映射到工作流级能量的五层观测管道,以及将每次测量绑定到硬件和运行时配置的可复现协议,形式化了能量归因。基于EpG,我们定义了编排开销指数(OOI),在相同任务标准下隔离编排相对于线性执行的能耗成本。在五个推理和三个工具增强任务族中,智能体工作流每个成功目标的平均能耗是线性基线的4.33倍(888.1 J vs 205.3 J)。这种开销由编排结构驱动,而非推理计算。对于工具增强任务,OOI反转至低于1.0倍:智能体执行比线性更便宜,确认该指标捕捉了编排结构而非固定的向上偏差。这些发现表明,每次推理能量对于智能体AI是不充分的。EpG和OOI为准确基准测试提供了测量基础,其中编排结构是能耗的主要决定因素。

英文摘要:

Current AI energy benchmarks measure consumption per model invocation. For agentic systems, where a single user goal may trigger multistep orchestration, tool calls, retries, and failure recovery, the invocation count is an implementation artifact rather than a task property, and per inference normalization misrepresents the energy cost of completing a goal. We present A-LEMS (Agentic LLM Energy Measurement System), a cross layer framework that redefines the unit of AI energy accounting as Energy per Successful Goal (EpG): total workflow energy across all attempts, including failures and retries, divided by successfully completed goals. A-LEMS combines a temporal boundary model, a five layer attribution pipeline mapping hardware signals (RAPL on x86; SPBM and DCGM on ARM) to workflow energy, and a reproducibility protocol binding every measurement to hardware, environment, and runtime configuration. Building on EpG, we define the Orchestration Overhead Index (OOI), the ratio of agentic to linear EpG on matched goals under identical success criteria. Across nine task families on Intel x86 and NVIDIA Grace GB10 ARM, CPU only OOI ranges 0.35x to 11.07x. Including GPU dynamic energy, which accounts for 83.8% of agentic EpG in local inference, widens this to 0.4x to 26.48x, so CPU only measurement understates overhead about twofold for reasoning tasks. For remote inference, network wait energy shifts OOI from 2.5x to 2.35x. The overhead arises from orchestration structure (planning, retries, recovery) that induces additional inference calls, not from costlier individual calls. The metric is not biased upward: single tool calculator dispatch inverts to OOI = 0.61x (95% CI [0.35, 0.97]) on x86. Goal level accounting via EpG and OOI provides a measurement foundation for benchmarking agentic AI.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑