THOR:一种用于端侧训练的通用能耗估算方法
THOR: A Generic Energy Estimation Approach for On-Device Training
AI总结:
本文提出THOR方法,通过利用DNN的逐层能耗可加性并结合高斯过程模型,实现了跨异构设备的通用端侧训练能耗估算,将MAPE降低高达30%,并成功指导能量感知剪枝将能耗降低50%。
摘要:
电池供电的移动设备(如智能手机、AR/VR眼镜和各种IoT设备)因其不断增长的算力以及对有价值、多样化和实时数据的便捷获取,正越来越多地被用于AI训练。端侧训练极其耗能,使得准确的能耗估算对于有效的作业调度和可持续AI至关重要。然而,设备的异构性和模型的复杂性挑战了现有估算方法的准确性和泛化能力。本文提出了THOR,一种用于深度神经网络(DNN)训练能耗估算的通用方法。首先,我们研究了DNN的逐层能耗可加性,并策略性地将整个模型划分为层,以进行细粒度的能耗分析。然后,我们拟合高斯过程(GP)模型,从逐层能耗测量中学习,并基于其逐层能耗可加性估算DNN的总能耗。我们在不同真实世界的平台上对各类模型进行了广泛实验。结果表明,THOR有效将平均绝对百分比误差(MAPE)降低了高达30%。此外,THOR被应用于指导能量感知剪枝,成功将能耗降低了50%,从而进一步证明了其通用性和潜力。
英文摘要:
Battery-powered mobile devices (e.g., smartphones, AR/VR glasses, and various IoT devices) are increasingly being used for AI training due to their growing computational power and easy access to valuable, diverse, and real-time data. On-device training is highly energy-intensive, making accurate energy consumption estimation crucial for effective job scheduling and sustainable AI. However, the heterogeneity of devices and the complexity of models challenge the accuracy and generalizability of existing estimation methods. This paper proposes THOR, a generic approach for energy consumption estimation in deep neural network (DNN) training. First, we examine the layer-wise energy additivity property of DNNs and strategically partition the entire model into layers for fine-grained energy consumption profiling. Then, we fit Gaussian Process (GP) models to learn from layer-wise energy consumption measurements and estimate a DNN's overall energy consumption based on its layer-wise energy additivity property. We conduct extensive experiments with various types of models across different real-world platforms. The results demonstrate that THOR has effectively reduced the Mean Absolute Percentage Error (MAPE) by up to 30%. Moreover, THOR is applied in guiding energy-aware pruning, successfully reducing energy consumption by 50%, thereby further demonstrating its generality and potential.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。