arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2007.14374cs.DCcs.LGeess.SP
收藏

加速移动边缘计算系统中可靠性不可知客户端的联邦学习

Accelerating Federated Learning over Reliability-Agnostic Clients in Mobile Edge Computing Systems

University of Warwick(华威大学);South China University of Technology(华南理工大学);Shenzhen University(深圳大学)

Wentai Wu, Ligang He, Weiwei Lin, Rui Mao

摘要:

移动边缘计算(MEC)结合了云、边缘节点和终端设备,在使数据处理更接近数据源方面显示出巨大的潜力。与此同时,联邦学习(FL)已经成为促进AI应用的一种有前途的隐私保护方法。然而,它仍然是一个很大的挑战,以优化效率和有效性的FL时,它与MEC架构集成。此外,不可靠的性质(例如,离散和间歇性辍学)的终端设备显着放缓FL过程,并影响全球模型的质量辛这种情况下。在本文中,多层联邦学习协议称为HybridFL设计的MEC架构。HybridFL采用边缘层和云层两个层次的模型聚合,并制定了不同的聚合策略。此外,为了减轻掉队者和终端设备辍学,我们引入区域松弛因素的边缘节点使用概率的方法,而不识别或探测终端设备的状态(其可靠性是不可知的)的客户端选择的阶段。我们证明了我们的方法在调制的客户端选择的比例的有效性,并提出了我们的协议的收敛性分析。我们已经进行了广泛的实验,机器学习任务在不同规模的MEC系统。结果表明,HybridFL显著改善了FL训练过程,缩短了联邦轮长度,加快了全局模型的收敛速度(高达12倍),并降低了终端设备的能耗(高达58%)。

英文摘要:

Mobile Edge Computing (MEC), which incorporates the Cloud, edge nodes and end devices, has shown great potential in bringing data processing closer to the data sources. Meanwhile, Federated learning (FL) has emerged as a promising privacy-preserving approach to facilitating AI applications. However, it remains a big challenge to optimize the efficiency and effectiveness of FL when it is integrated with the MEC architecture. Moreover, the unreliable nature (e.g., stragglers and intermittent drop-out) of end devices significantly slows down the FL process and affects the global model's quality Xin such circumstances. In this paper, a multi-layer federated learning protocol called HybridFL is designed for the MEC architecture. HybridFL adopts two levels (the edge level and the cloud level) of model aggregation enacting different aggregation strategies. Moreover, in order to mitigate stragglers and end device drop-out, we introduce regional slack factors into the stage of client selection performed at the edge nodes using a probabilistic approach without identifying or probing the state of end devices (whose reliability is agnostic). We demonstrate the effectiveness of our method in modulating the proportion of clients selected and present the convergence analysis for our protocol. We have conducted extensive experiments with machine learning tasks in different scales of MEC system. The results show that HybridFL improves the FL training process significantly in terms of shortening the federated round length, speeding up the global model's convergence (by up to 12X) and reducing end device energy consumption (by up to 58%).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑