AI-CARE: 用于AI模型的碳感知报告评估指标
AI-CARE: Carbon-Aware Reporting Evaluation Metric for AI Models
AI总结:
AI-CARE提出了一种用于评估AI模型能耗和碳排放的工具,通过碳性能权衡曲线促进环境友好的模型设计。
摘要:
随着机器学习(ML)的持续快速扩展,模型训练和推理的环境成本已成为一个关键的社会关注点。现有的基准测试大多专注于标准性能指标,如准确率、BLEU或mAP,而几乎忽视了能耗和碳排放。这种单一目标评估范式越来越与大规模部署的实际需求不匹配,特别是在能源受限的环境中,如移动设备、发展中国家和气候意识企业。在本文中,我们提出了一种用于报告机器学习模型能耗和碳排放的评估工具。此外,我们引入了碳性能权衡曲线,这是一种可解释的工具,用于可视化性能和碳成本之间的帕累托前沿。通过理论分析和在代表性ML工作负载上的实证验证,我们证明了碳感知基准测试改变了模型的相对排名,并鼓励同时准确且环境负责的架构。我们的提议旨在将研究社区转向透明的多目标评估,并使ML进步与全球可持续发展目标相一致。该工具和文档可在https://github.com/USD-AI-ResearchLab/ai-care上获得。
英文摘要:
As machine learning (ML) continues its rapid expansion, the environmental cost of model training and inference has become a critical societal concern. Existing benchmarks overwhelmingly focus on standard performance metrics such as accuracy, BLEU, or mAP, while largely ignoring energy consumption and carbon emissions. This single-objective evaluation paradigm is increasingly misaligned with the practical requirements of large-scale deployment, particularly in energy-constrained environments such as mobile devices, developing regions, and climate-aware enterprises. In this paper, we propose AI-CARE, an evaluation tool for reporting energy consumption, and carbon emissions of ML models. In addition, we introduce the carbon-performance tradeoff curve, an interpretable tool that visualizes the Pareto frontier between performance and carbon cost. We demonstrate, through theoretical analysis and empirical validation on representative ML workloads, that carbon-aware benchmarking changes the relative ranking of models and encourages architectures that are simultaneously accurate and environmentally responsible. Our proposal aims to shift the research community toward transparent, multi-objective evaluation and align ML progress with global sustainability goals. The tool and documentation are available at https://github.com/USD-AI-ResearchLab/ai-care.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。