arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2503.13624cs.DC
收藏

SDFLMQ:一种基于 MQTT 的半去中心化联邦学习框架

SDFLMQ: A Semi-Decentralized Federated Learning Framework over MQTT

Amir Ali-Pour, Julien Gascon-Samson

AI总结:

本文提出 SDFLMQ,一种基于 MQTT 发布/订阅机制的边缘半去中心化联邦学习框架,以支持聚类、负载均衡和高效聚合。

摘要:

联邦学习作为一种强调保护数据隐私的分布式机器学习概念而被广泛讨论。人们提出了各种联邦学习结构。例如,中心化联邦学习一直是适合云计算的主要结构。去中心化联邦学习也已被提出,用于通信主要为点对点的生态系统。半去中心化联邦学习(SDFL)最近作为一种新概念出现,其中互连节点被聚类,并且每个聚类被独立管理。SDFL 的潜力在于其聚类特性,该特性将全局模型更新的负载分发到多个节点上。由于该概念还相当新,因此仍有许多工作可以做,以使这种联邦学习模型在边缘成为可靠、高效和实时的服务。在本文中,我们提出了 SDFLMQ,这是一种位于边缘的半去中心化联邦学习框架,使用 MQTT 作为通信协议。我们展示了如何使用发布/订阅通信模型来促进 SDFL 中的聚类和负载均衡。我们还展示了 SDFLMQ 如何利用 MQTT 的一些核心特性,在不产生显著成本的情况下扩展其容量。基于一些初步评估,我们展示了 SDFLMQ 如何高效地分发聚合负载,并有可能节省不必要的内存分配,而这一切都不需要强大的中央单元来进行聚合和全局模型更新。我们还披露了 SDFLMQ 的一些关键未来扩展,重点关注在边缘运行大型深度神经网络模型。

英文摘要:

Federated Learning is widely discussed as a distributed machine learning concept with stress on preserving data privacy. Various structures of Federated Learning were proposed. Centralized Federated learning for instance has been the primary structure that suits cloud computing. Decentralized Federated learning also has been proposed for ecosystems where communication is dominantly peer-to-peer. Semi-Decentralized Federated Learning (SDFL) has emerged recently as a new concept where the interconnected nodes are clustered, and each cluster is managed independently. The potential of SDFL lies in its clustering feature, which distributes the load of the global model update down onto multiple nodes. Since the concept is fairly new, much can be done to render this FL model a reliable, efficient, and real-time service at the edge. In this paper, we propose SDFLMQ, a semi-decentralized Federated learning framework at the Edge that uses MQTT as the communication protocol. We demonstrate how the publish/subscribe communication model is used to facilitate the clustering and load balancing in SDFL. We also demonstrate how SDFLMQ can use some of the core MQTT features to expand its capacity with no significant costs. Based on some primary evaluations, we demonstrate how SDFLMQ can efficiently distribute the load of aggregation, and potentially save unnecessary memory allocation, all with no requirement for a powerful central unit for aggregation and global model update. We also disclose some of the key future expansions of SDFLMQ with a focus on the operation of large deep neural network models at the edge.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑