arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2108.09103cs.LGcs.NIcs.SYeess.SY
收藏

分层无线网络中的移动性感知集群联邦学习

Mobility-Aware Cluster Federated Learning in Hierarchical Wireless Networks

Singapore University of Technology and Design(新加坡科技设计大学);Zhejiang University/University of Illinois at Urbana-Champaign Institute, Zhejiang University(浙江大学伊利诺伊大学厄巴纳-香槟校区联合学院,浙江大学);Harbin Institute of Technology(哈尔滨工业大学);University of Electronic Science and Technology of China(电子科技大学);The University of Exeter(埃克塞特大学)

Chenyuan Feng, Howard H. Yang, Deshun Hu, Zhiwei Zhao, Tony Q. S. Quek, Geyong Min

摘要:

在无线网络中实现联邦学习(FL)算法已经引起了广泛的关注。然而,很少有工作考虑到用户的移动性对学习性能的影响。为了填补这一研究空白,首先,我们开发了一个理论模型来描述分层联邦学习(HFL)算法在无线网络中的移动用户可能会漫游在多个边缘接入点,导致FL训练不完整的不一致。其次,我们提供了HFL与用户移动性的收敛性分析。我们的分析证明,HFL的学习性能急剧恶化与高移动用户。而这种学习性能的下降将随着参与者数量的减少和用户本地数据之间的大数据分布差异而加剧。为了解决这些问题,我们提出了一个移动感知集群联邦学习(MACFL)算法,通过重新设计的访问机制,本地更新规则和模型聚合方案。最后,我们提供实验来评估HFL和我们的MACFL的学习性能。实验结果表明,MACFL算法能够提高学习性能,特别是在三种不同的情况下,即用户分布数据不独立且相同的情况下,用户移动性高的情况下,以及用户数量较少的情况下.

英文摘要:

Implementing federated learning (FL) algorithms in wireless networks has garnered a wide range of attention. However, few works have considered the impact of user mobility on the learning performance. To fill this research gap, firstly, we develop a theoretical model to characterize the hierarchical federated learning (HFL) algorithm in wireless networks where the mobile users may roam across multiple edge access points, leading to incompletion of inconsistent FL training. Secondly, we provide the convergence analysis of HFL with user mobility. Our analysis proves that the learning performance of HFL deteriorates drastically with highly-mobile users. And this decline in the learning performance will be exacerbated with small number of participants and large data distribution divergences among local data of users. To circumvent these issues, we propose a mobility-aware cluster federated learning (MACFL) algorithm by redesigning the access mechanism, local update rule and model aggregation scheme. Finally, we provide experiments to evaluate the learning performance of HFL and our MACFL. The results show that our MACFL can enhance the learning performance, especially for three different cases, namely, the case of users with non-independent and identical distribution data, the case of users with high mobility, and the cases with a small number of users.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑