arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2305.18889cs.DC
收藏

分割联邦学习:在资源受限的无线网络中加速模型训练

Split Federated Learning: Speed up Model Training in Resource-Limited Wireless Networks

Songge Zhang, Wen Wu, Penghui Hu, Shaofeng Li, Ning Zhang

AI总结:

本文提出基于分组的分割联邦学习(GSFL),通过“先分割后联邦”的三步流程在资源受限无线网络中加速AI模型训练,仿真表明其在训练时延上优于分割学习和联邦学习且准确率令人满意。

摘要:

本文提出了一种新颖的分布式学习方案,称为基于分组的分割联邦学习(GSFL),以加速人工智能(AI)模型训练。具体而言,GSFL以“先分割后联邦”的方式运行,包括三个步骤:1)模型分发,接入点(AP)分割AI模型并将客户端侧模型分发给客户端;2)模型训练,每个客户端执行前向传播并将打碎的数据传输到边缘服务器。边缘服务器执行前向和反向传播,然后将梯度返回给客户端以更新本地客户端侧模型;3)模型聚合,边缘服务器聚合服务器侧和客户端侧模型。仿真结果表明,GSFL在整体训练时延方面优于普通分割学习和联邦学习方案,同时达到令人满意的准确率。

英文摘要:

In this paper, we propose a novel distributed learning scheme, named group-based split federated learning (GSFL), to speed up artificial intelligence (AI) model training. Specifically, the GSFL operates in a split-then-federated manner, which consists of three steps: 1) Model distribution, in which the access point (AP) splits the AI models and distributes the client-side models to clients; 2) Model training, in which each client executes forward propagation and transmit the smashed data to the edge server. The edge server executes forward and backward propagation and then returns the gradient to the clients for updating local client-side models; and 3) Model aggregation, in which edge servers aggregate the server-side and client-side models. Simulation results show that the GSFL outperforms vanilla split learning and federated learning schemes in terms of overall training latency while achieving satisfactory accuracy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑