arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2108.02891cs.LGcs.AIeess.SP
收藏

基于空中计算的联邦学习用户调度

User Scheduling for Federated Learning Through Over-the-Air Computation

Utah State University(犹他州立大学);University of Wisconsin-Whitewater(威斯康星大学怀特沃特分校)

Xiang Ma, Haijian Sun, Qun Wang, Rose Qingyang Hu

摘要:

联邦学习(FL)是一种新的机器学习(ML)技术,旨在将数据保存在边缘设备上,并在学习过程中只交换ML模型参数。FL不仅减少了通信需求,而且有助于保护本地隐私。尽管FL具有这些优点,但当存在连接到中央参数服务器(PS)的大量边缘设备和/或学习过程中涉及的数百万个模型参数时,它仍然会经历较大的通信延迟。空中计算(AirComp)能够通过使用模拟调制允许多个设备同时发送数据来在传输数据的同时进行计算。为了通过AirComp在FL中实现良好的性能,用户调度起着关键作用。在本文中,我们调查和比较不同的用户调度策略,这是基于各种标准,如无线信道条件和模型更新的意义。接收机波束形成应用于最小化通过AirComp的函数聚合结果的失真的均方误差(MSE)。仿真结果表明,基于模型更新重要性的调度在训练过程中波动较小,而基于信道条件的调度在能量效率上具有优势。

英文摘要:

A new machine learning (ML) technique termed as federated learning (FL) aims to preserve data at the edge devices and to only exchange ML model parameters in the learning process. FL not only reduces the communication needs but also helps to protect the local privacy. Although FL has these advantages, it can still experience large communication latency when there are massive edge devices connected to the central parameter server (PS) and/or millions of model parameters involved in the learning process. Over-the-air computation (AirComp) is capable of computing while transmitting data by allowing multiple devices to send data simultaneously by using analog modulation. To achieve good performance in FL through AirComp, user scheduling plays a critical role. In this paper, we investigate and compare different user scheduling policies, which are based on various criteria such as wireless channel conditions and the significance of model updates. Receiver beamforming is applied to minimize the mean-square-error (MSE) of the distortion of function aggregation result via AirComp. Simulation results show that scheduling based on the significance of model updates has smaller fluctuations in the training process while scheduling based on channel condition has the advantage on energy efficiency.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑