重新审视用于间歇供电能量采集微型计算机的DNN训练
Revisiting DNN Training for Intermittently-Powered Energy-Harvesting Micro-Computers
AI总结:
针对能量采集微型计算机的间歇供电问题,提出动态dropout训练方法,结合设备模型与能量概况优化训练,在额外计算低于5%时提升6-22%准确率。
摘要:
在能量受限环境中(如能量采集无线传感器网络)部署深度神经网络面临独特挑战,主要源于供电的间歇性。为应对这些挑战,本研究引入并评估了一种针对此类环境下运行的DNN量身定制的新型训练方法。具体而言,我们提出了一种动态dropout技术,该技术能适应设备架构以及能量采集场景中固有的能量可用性变化。我们提出的方法利用一个设备模型,该模型结合了网络架构的具体参数和能量采集概况,以在训练阶段动态优化dropout率。通过基于预测的能量可用性来调节网络的训练过程,我们的方法不仅节约能量,还确保在功率限制下维持学习和推理能力。初步结果表明,与最先进方法相比,该策略在额外计算开销低于5%的情况下,实现了6%至22%的准确率提升。本文详述了设备模型的开发,描述了将能量概况与间歇感知dropout及量化算法集成,并利用真实世界能量采集数据对所提方法进行了全面评估。
英文摘要:
The deployment of Deep Neural Networks in energy-constrained environments, such as Energy Harvesting Wireless Sensor Networks, presents unique challenges, primarily due to the intermittent nature of power availability. To address these challenges, this study introduces and evaluates a novel training methodology tailored for DNNs operating within such contexts. In particular, we propose a dynamic dropout technique that adapts to both the architecture of the device and the variability in energy availability inherent in energy harvesting scenarios. Our proposed approach leverages a device model that incorporates specific parameters of the network architecture and the energy harvesting profile to optimize dropout rates dynamically during the training phase. By modulating the network's training process based on predicted energy availability, our method not only conserves energy but also ensures sustained learning and inference capabilities under power constraints. Our preliminary results demonstrate that this strategy provides 6 to 22 percent accuracy improvements compared to the state of the art with less than 5 percent additional compute. This paper details the development of the device model, describes the integration of energy profiles with intermittency aware dropout and quantization algorithms, and presents a comprehensive evaluation of the proposed approach using real-world energy harvesting data.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。