arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.05602cs.LG
收藏

归一化能耗以实现与硬件无关的评估

Normalizing Energy Consumption for Hardware-Independent Evaluation

Université de Lorraine(洛林大学);CNRS(法国国家科学研究中心);Inria(法国国家信息与自动化研究所);Loria(洛林计算机科学与应用实验室)

Constance Douwes, Romain Serizel

AI总结:

针对不同GPU导致ML训练能耗难以公平比较的问题,本文提出硬件无关的能耗归一化方法,并在音频标注任务中验证参考点、回归方式及计算指标对预测精度的影响。

摘要:

机器学习(ML)模型在信号处理中的应用日益广泛,这引发了人们对其环境影响的担忧,尤其是在资源密集的训练阶段。本研究提出了一种新颖的方法,用于对不同硬件平台上的能耗进行归一化,以促进公平、一致的比较。我们通过测量在不同GPU上训练不同ML架构所消耗的能量来评估不同的归一化策略,重点关注音频标注任务。我们的方法表明,参考点数量、回归类型以及计算指标的纳入会显著影响归一化过程。我们发现,适当选择两个参考点可提供稳健的归一化,而纳入浮点运算次数和参数数量可提高能耗预测的准确性。通过支持更准确的能耗评估,我们的方法推动了环境可持续ML实践的发展。

英文摘要:

The increasing use of machine learning (ML) models in signal processing has raised concerns about their environmental impact, particularly during resource-intensive training phases. In this study, we present a novel methodology for normalizing energy consumption across different hardware platforms to facilitate fair and consistent comparisons. We evaluate different normalization strategies by measuring the energy used to train different ML architectures on different GPUs, focusing on audio tagging tasks. Our approach shows that the number of reference points, the type of regression and the inclusion of computational metrics significantly influences the normalization process. We find that the appropriate selection of two reference points provides robust normalization, while incorporating the number of floating-point operations and parameters improves the accuracy of energy consumption predictions. By supporting more accurate energy consumption evaluation, our methodology promotes the development of environmentally sustainable ML practices.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑