arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2505.04435cs.LGcs.AI
收藏

FedBWO:提升联邦学习中的通信效率

FedBWO: Enhancing Communication Efficiency in Federated Learning

Department of Computer Engineering, Koç University(计算机工程系,科大学院)

Vahideh Hayyolalam, Öznur Özkasap

AI总结:

本文提出FedBWO方法,通过仅传输性能分数而非模型权重来减少联邦学习通信量,并利用黑寡妇优化算法改进本地更新,显著提升全局模型准确率和通信效率。

摘要:

联邦学习(FL)是一种分布式机器学习(ML)设置,其中共享模型由各个客户端使用其本地数据集协作训练,同时保持数据隐私。考虑到资源受限的设备,FL客户端通常受到传输容量的限制。为了提高系统性能,需要减少客户端与服务器之间的通信。当前的FL策略在FL过程中传输大量数据(模型权重),这需要较高的通信带宽。考虑到资源约束,增加客户端数量以及随之而来的数据量(模型权重)可能导致瓶颈。在本文中,我们引入了联邦黑寡妇优化(FedBWO)技术,通过仅从客户端传输性能分数而非本地模型权重来减少传输的数据量。FedBWO采用BWO算法来改进本地模型更新。所进行的实验证明,FedBWO显著提高了全局模型的性能和整个系统的通信效率。根据实验结果,FedBWO将全局模型准确率平均比FedAvg提高了21%,比FedGWO提高了12%。此外,与其他方法相比,FedBWO大幅降低了通信成本。

英文摘要:

Federated Learning (FL) is a distributed Machine Learning (ML) setup, where a shared model is collaboratively trained by various clients using their local datasets while keeping the data private. Considering resource-constrained devices, FL clients often suffer from restricted transmission capacity. Aiming to enhance the system performance, the communication between clients and server needs to be diminished. Current FL strategies transmit a tremendous amount of data (model weights) within the FL process, which needs a high communication bandwidth. Considering resource constraints, increasing the number of clients and, consequently, the amount of data (model weights) can lead to a bottleneck. In this paper, we introduce the Federated Black Widow Optimization (FedBWO) technique to decrease the amount of transmitted data by transmitting only a performance score rather than the local model weights from clients. FedBWO employs the BWO algorithm to improve local model updates. The conducted experiments prove that FedBWO remarkably improves the performance of the global model and the communication efficiency of the overall system. According to the experimental outcomes, FedBWO enhances the global model accuracy by an average of 21% over FedAvg, and 12% over FedGWO. Furthermore, FedBWO dramatically decreases the communication cost compared to other methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑