arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.18387cs.DCcs.AIcs.ETcs.LGcs.PF
收藏

SCALE:同质环境中的自调节聚类联邦学习

SCALE: Self-regulated Clustered federAted LEarning in a Homogeneous Environment

School of Computing(计算机学院);Southern Illinois University Carbondale(南伊利诺伊大学卡本代尔分校);The University of Texas at Arlington(德克萨斯大学阿灵顿分校);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)

Sai Puppala, Ismail Hossain, Md Jahangir Alam, Sajedul Talukder, Zahidur Talukder, Syed Bahauddin

AI总结:

本文提出SCALE方法,通过动态集群形成和混合去中心化聚合协议消除对边缘服务器的依赖,在保持高学习性能的同时将通信开销降低近十倍,显著减少训练延迟和能耗。

摘要:

联邦学习(FL)已成为一种变革性方法,能够在保护用户隐私的同时实现分布式机器学习,但它面临着通信效率低下和依赖中心化基础设施等挑战,导致延迟和成本增加。本文提出了一种新颖的 FL 方法,通过消除对边缘服务器的依赖来克服这些限制,采用服务器辅助的 Proximity Evaluation,基于数据相似性、性能指数和地理邻近性进行动态集群形成。我们的集成方法通过 Hybrid Decentralized Aggregation Protocol 提高了运行效率和可扩展性,该协议将本地模型训练与对等权重交换以及由动态选举的驱动节点管理的中心化最终聚合相结合,显著减少了全局通信开销。此外,该方法包括 Decentralized Driver Selection、用于减少网络流量的 Check-pointing 以及用于系统鲁棒性的 Health Status Verification Mechanism。使用乳腺癌数据集进行验证,我们的架构不仅展示了通信开销近十倍的减少,还在保持高学习性能的同时,在减少训练延迟和能耗方面显示出显著改善,为未来联邦学习生态系统提供了可扩展、高效且保护隐私的解决方案。

英文摘要:

Federated Learning (FL) has emerged as a transformative approach for enabling distributed machine learning while preserving user privacy, yet it faces challenges like communication inefficiencies and reliance on centralized infrastructures, leading to increased latency and costs. This paper presents a novel FL methodology that overcomes these limitations by eliminating the dependency on edge servers, employing a server-assisted Proximity Evaluation for dynamic cluster formation based on data similarity, performance indices, and geographical proximity. Our integrated approach enhances operational efficiency and scalability through a Hybrid Decentralized Aggregation Protocol, which merges local model training with peer-to-peer weight exchange and a centralized final aggregation managed by a dynamically elected driver node, significantly curtailing global communication overhead. Additionally, the methodology includes Decentralized Driver Selection, Check-pointing to reduce network traffic, and a Health Status Verification Mechanism for system robustness. Validated using the breast cancer dataset, our architecture not only demonstrates a nearly tenfold reduction in communication overhead but also shows remarkable improvements in reducing training latency and energy consumption while maintaining high learning performance, offering a scalable, efficient, and privacy-preserving solution for the future of federated learning ecosystems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑