arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.07150cs.LGcs.AI
收藏

移动边缘计算系统中基于拍卖的分布式联邦学习

Auction Based Clustered Federated Learning in Mobile Edge Computing System

School of Computer Science and Technology, Harbin Institute of Technology(哈尔滨工业大学计算机科学与技术学院);Cyberspace Security Research Center, Peng Cheng Laboratory(鹏城实验室网络空间安全研究中心);School of Electrical and Data Engineering, University of Technology Sydney(悉尼科技大学电气与数据工程学院);Department of Computer Science and Technology, Fuzhou University(福州大学计算机科学与技术学院);Department of Computer Science, Electrical and Space Engineering, Lulea University of Technology(吕勒奥理工大学计算机、电气与空间工程系)

Renhao Lu, Weizhe Zhang, Qiong Li, Xiaoxiong Zhong, Athanasios V. Vasilakos

摘要:

近年来,移动客户端的计算能力和存储能力有了很大的提高,可以有效地在本地处理一些应用。联邦学习是一种很有前途的分布式机器学习解决方案,它使用本地计算和本地数据来训练人工智能(AI)模型。将本地计算和联邦学习相结合,可以在充分利用移动客户端资源的同时,在保证本地数据隐私的前提下,训练出强大的AI模型。然而,局部数据的异构性,即非独立同分布(Non-IID)和局部数据规模的不均衡性,可能会成为阻碍联邦学习在移动边缘计算(MEC)系统中应用的瓶颈。受此启发,我们提出了一种基于集群的客户端选择方法,可以生成一个联邦虚拟数据集,满足全球分布,以抵消数据异构性的影响,并证明了所提出的计划可以收敛到一个近似的最优解。在此基础上,提出了一种基于拍卖的客户选择策略,充分考虑了系统的能量异质性,并给出了该策略的纳什均衡解,以均衡能量消耗,提高收敛速度.仿真结果表明,我们提出的选择方法和基于拍卖的联邦学习可以实现更好的性能与卷积神经网络模型(CNN)在不同的数据分布。

英文摘要:

In recent years, mobile clients' computing ability and storage capacity have greatly improved, efficiently dealing with some applications locally. Federated learning is a promising distributed machine learning solution that uses local computing and local data to train the Artificial Intelligence (AI) model. Combining local computing and federated learning can train a powerful AI model under the premise of ensuring local data privacy while making full use of mobile clients' resources. However, the heterogeneity of local data, that is, Non-independent and identical distribution (Non-IID) and imbalance of local data size, may bring a bottleneck hindering the application of federated learning in mobile edge computing (MEC) system. Inspired by this, we propose a cluster-based clients selection method that can generate a federated virtual dataset that satisfies the global distribution to offset the impact of data heterogeneity and proved that the proposed scheme could converge to an approximate optimal solution. Based on the clustering method, we propose an auction-based clients selection scheme within each cluster that fully considers the system's energy heterogeneity and gives the Nash equilibrium solution of the proposed scheme for balance the energy consumption and improving the convergence rate. The simulation results show that our proposed selection methods and auction-based federated learning can achieve better performance with the Convolutional Neural Network model (CNN) under different data distributions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑