arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2310.02550cs.ITeess.SPmath.IT
收藏

面向海量物联网网络的半联邦学习收敛性分析与时延最小化

Convergence Analysis and Latency Minimization for Semi-Federated Learning in Massive IoT Networks

Jianyang Ren, Wanli Ni, Hui Tian, Gaofeng Nie

AI总结:

针对海量物联网场景下联邦学习时延过高的问题,提出结合网络剪枝与空中计算的半联邦学习范式,分析其收敛上界并设计迭代算法求解收敛约束下的时延最小化问题,仿真验证了方案可降时延且保准确率。

摘要:

随着物联网(IoT)网络中传感器数量变得极为庞大,数据量也十分巨大。为在保护用户隐私的同时实时处理数据,联邦学习(FL)被视为将边缘智能引入具备海量设备的物联网网络的使能技术。然而,由于深度神经网络参数数量增加,且物联网设备的计算与通信能力有限,FL时延急剧上升。为解决该问题,我们提出一种半联邦学习(SemiFL)范式,该范式高效结合了网络剪枝与空中计算技术。具体而言,每个小型基站从其服务的传感器处收集原始数据,并训练自身的局部剪枝模型。随后,局部梯度的全局聚合通过空中计算实现。我们首先通过推导收敛上界分析了所提出SemiFL的性能。为降低时延,我们构建了一个受收敛约束的SemiFL时延最小化问题。通过将原问题解耦为若干子问题,我们设计了迭代算法以高效求解这些子问题。最后,我们开展了数值仿真,验证了所提方案在降低时延并保证识别准确率方面的有效性。

英文摘要:

As the number of sensors becomes massive in Internet of Things (IoT) networks, the amount of data is humongous. To process data in real-time while protecting user privacy, federated learning (FL) has been regarded as an enabling technique to push edge intelligence into IoT networks with massive devices. However, FL latency increases dramatically due to the increase of the number of parameters in deep neural network and the limited computation and communication capabilities of IoT devices. To address this issue, we propose a semi-federated learning (SemiFL) paradigm in which network pruning and over-the-air computation are efficiently applied. To be specific, each small base station collects the raw data from its served sensors and trains its local pruned model. After that, the global aggregation of local gradients is achieved through over-the-air computation. We first analyze the performance of the proposed SemiFL by deriving its convergence upper bound. To reduce latency, a convergence-constrained SemiFL latency minimization problem is formulated. By decoupling the original problem into several sub-problems, iterative algorithms are designed to solve them efficiently. Finally, numerical simulations are conducted to verify the effectiveness of our proposed scheme in reducing latency and guaranteeing the identification accuracy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑