arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.12957cs.DC
收藏

基于双重自适应量化的节能无线联邦学习

Energy-Efficient Wireless Federated Learning via Doubly Adaptive Quantization

Xuefeng Han, Wen Chen, Jun Li, Ming Ding, Qingqing Wu, Kang Wei, Xiumei Deng, Zhen Mei

AI总结:

针对无线联邦学习中通信开销大、能耗高及客户端异构性问题,提出联合设计量化、调度、信道与计算频率的QCCF方法,通过Lyapunov优化推导出双重自适应量化闭式解,实现更低能耗与更快收敛。

摘要:

联邦学习(FL)已被认为是一种可行的分布式学习范式,无需上传原始数据即可在分布式客户端上训练机器学习模型。然而,无线网络中的FL仍面临两大主要挑战,即巨大的通信开销和高能耗,而数据集大小和无线信道的客户端异构性加剧了这些挑战。虽然模型量化对降低能耗很有效,但现有工作忽略了将量化适应于异构客户端和FL收敛。为了解决这些挑战,本文开发了一个在无线FL中联合设计量化级别、调度客户端、分配信道和控制计算频率(QCCF)的能耗优化问题。具体而言,我们推导出了一个上界,用于识别客户端调度和量化误差对FL收敛的影响。在长期收敛约束和无线约束下,该问题被建立并通过Lyapunov优化转化为一个瞬时问题。通过求解Karush-Kuhn-Tucker条件,我们的闭式解表明双重自适应量化级别随训练过程而上升,并与数据集大小负相关。实验结果验证了我们的理论结果,表明与最先进的基线相比,QCCF消耗的能量更少且收敛更快。

英文摘要:

Federated learning (FL) has been recognized as a viable distributed learning paradigm for training a machine learning model across distributed clients without uploading raw data. However, FL in wireless networks still faces two major challenges, i.e., large communication overhead and high energy consumption, which are exacerbated by client heterogeneity in dataset sizes and wireless channels. While model quantization is effective for energy reduction, existing works ignore adapting quantization to heterogeneous clients and FL convergence. To address these challenges, this paper develops an energy optimization problem of jointly designing quantization levels, scheduling clients, allocating channels, and controlling computation frequencies (QCCF) in wireless FL. Specifically, we derive an upper bound identifying the influence of client scheduling and quantization errors on FL convergence. Under the longterm convergence constraints and wireless constraints, the problem is established and transformed into an instantaneous problem with Lyapunov optimization. Solving Karush-Kuhn-Tucker conditions, our closed-form solution indicates that the doubly adaptive quantization level rises with the training process and correlates negatively with dataset sizes. Experiment results validate our theoretical results, showing that QCCF consumes less energy with faster convergence compared with state-of-the-art baselines.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑