arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.07853cs.LG
收藏

使用Nvidia GPU和混合精度训练改进分类模型的机器学习碳足迹——第一部分

Improve Machine Learning carbon footprint using Nvidia GPU and Mixed Precision training for classification models -- Part I

Sony(索尼)

Andrew Antonopoulos

AI总结:

本文通过定制PC实验比较32位浮点与Nvidia混合精度训练分类DNN的功耗,发现混合精度结合特定超参数可降低7-11瓦功耗及碳足迹,但统计检验未见显著性,建议扩大GPU集群样本量。

摘要:

本文是作者硕士论文的第一部分,比较了在训练分类机器学习模型时使用默认浮点(32位)和Nvidia混合精度(16位和32位)的功耗。实验搭建了一台具有特定硬件的定制PC,并选择了不同的机器学习超参数,如批大小、神经元数量和训练轮数,来构建深度神经网络(DNN)。此外,实验过程中使用了多种软件来收集图形处理单元(GPU)、中央处理单元(CPU)、随机存取存储器(RAM)的功耗数据(单位:瓦特),并通过连接到墙壁的瓦特计手动记录数据。使用DNN默认超参数值的基准测试作为参考,而实验则采用了不同设置的组合。结果记录在Excel中,并选择描述性统计来计算各组之间的均值,并通过图表和表格进行比较。当混合精度与特定超参数结合使用时,结果是积极的。与基准测试相比,分类优化将功耗降低了7至11瓦特。同样,由于计算使用相同的功耗数据,碳足迹也得以减少。但在配置超参数时仍需注意,因为它可能对硬件性能产生负面影响。然而,本研究需要推断统计,特别是ANOVA和T检验,来比较均值之间的关系。此外,测试表明基准测试与实验之间的关系没有统计显著性。不过,使用GPU集群进行更大规模的实施可以显著增加样本量,因为样本量是一个重要因素,可能改变统计分析的结果。

英文摘要:

This is the 1st part of the dissertation for my master degree and compares the power consumption using the default floating point (32bit) and Nvidia mixed precision (16bit and 32bit) while training a classification ML model. A custom PC with specific hardware was built to perform the experiments, and different ML hyper-parameters, such as batch size, neurons, and epochs, were chosen to build Deep Neural Networks (DNN). Additionally, various software was used during the experiments to collect the power consumption data in Watts from the Graphics Processing Unit (GPU), Central Processing Unit (CPU), Random Access Memory (RAM) and manually from a wattmeter connected to the wall. A benchmarking test with default hyper parameter values for the DNN was used as a reference, while the experiments used a combination of different settings. The results were recorded in Excel, and descriptive statistics were chosen to calculate the mean between the groups and compare them using graphs and tables. The outcome was positive when using mixed precision combined with specific hyper-parameters. Compared to the benchmarking, the optimisation for the classification reduced the power consumption between 7 and 11 Watts. Similarly, the carbon footprint is reduced because the calculation uses the same power consumption data. Still, a consideration is required when configuring hyper-parameters because it can negatively affect hardware performance. However, this research required inferential statistics, specifically ANOVA and T-test, to compare the relationship between the means. Furthermore, tests indicated no statistical significance of the relationship between the benchmarking and experiments. However, a more extensive implementation with a cluster of GPUs can increase the sample size significantly, as it is an essential factor and can change the outcome of the statistical analysis.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑