计算各层级的能量估算:从设备到机器学习在自然语言处理、科学计算和加密货币挖掘中的大规模应用
Energy Estimates Across Layers of Computing: From Devices to Large-Scale Applications in Machine Learning for Natural Language Processing, Scientific Computing, and Cryptocurrency Mining
AI总结:
该研究估算并分析了从设备到算法各计算层级的能量使用,指出指令和模拟级别能耗更高,并强调将能量作为设计参数以支持计算密集型应用。
摘要:
对从设备到算法等计算各层级的能量使用估算进行了确定和分析。基于先前的分析[3],估算了单个设备和系统所需的能量,包括人工智能(AI)/机器学习用于自然语言处理、科学模拟和加密货币挖掘等三个大规模计算应用。与位级切换(其中晶体管因几何缩放而实现能量效率)相比,在应用程序的指令级和模拟级消耗了更高的能量。此外,基于AI/ML加速器的分析表明,使用较旧半导体技术节点的架构变化与使用较新技术的不同架构具有相当的能量效率。进一步将计算系统的能量与热力学和生物学极限进行比较,表明应用程序的完全模拟需要高出27-36个数量级的能量。这些能量估算强调了在计算中认真考虑能量效率的必要性,通过将能量作为设计参数,以满足数字世界中计算密集型应用日益增长的需求。
英文摘要:
Estimates of energy usage in layers of computing from devices to algorithms have been determined and analyzed. Building on the previous analysis [3], energy needed from single devices and systems including three large-scale computing applications such as Artificial Intelligence (AI)/Machine Learning for Natural Language Processing, Scientific Simulations, and Cryptocurrency Mining have been estimated. In contrast to the bit-level switching, in which transistors achieved energy efficiency due to geometrical scaling, higher energy is expended both at the at the instructions and simulations levels of an application. Additionally, the analysis based on AI/ML Accelerators indicate that changes in architectures using an older semiconductor technology node have comparable energy efficiency with a different architecture using a newer technology. Further comparisons of the energy in computing systems with the thermodynamic and biological limits, indicate that there is a 27-36 orders of magnitude higher energy requirements for total simulation of an application. These energy estimates underscore the need for serious considerations of energy efficiency in computing by including energy as a design parameter, enabling growing needs of compute-intensive applications in a digital world.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。