arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.04849cs.LGcs.AI
收藏

FedModule:一个模块化联邦学习框架

FedModule: A Modular Federated Learning Framework

College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics(南京航空航天大学计算机科学与技术学院)

Chuyi Chen, Zhe Zhang, Yanchao Zhao

AI总结:

针对现有联邦学习框架难以适配复杂场景的问题,本文提出开源模块化框架 FedModule,通过组件化设计支持多种范式、20 余种算法和多种执行模式,并展现出更优的扩展性与基准支持。

摘要:

联邦学习(FL)已被广泛应用于医疗、金融和智慧城市等多种场景。然而,随着实验场景变得更加复杂,现有 FL 框架和基准已难以跟上发展。本文介绍 FedModule,这是一个灵活且可扩展的 FL 实验框架,已开源,用于支持多种 FL 范式,并为复杂实验场景提供全面基准。FedModule 遵循“一套代码,覆盖所有场景”的原则,采用模块化设计,将 FL 流程拆分为独立组件,从而实现不同 FL 范式的无缝集成。该框架支持同步、异步和个性化联邦学习,已实现 20 多种算法。在公共数据集上开展的实验证明了 FedModule 的灵活性和可扩展性。该框架提供多种执行模式,包括线性、线程、基于进程和分布式模式,使用户能够根据各种实验需求定制其设置。此外,FedModule 提供丰富的日志记录和测试能力,便于对 FL 算法进行详细性能分析。与 TensorFlow Federated、PySyft、Flower 和 FLGo 等现有 FL 工具包的比较评估表明,FedModule 在可扩展性、灵活性和全面基准支持方面表现更优。通过解决当前 FL 框架的局限,FedModule 标志着 FL 实验的一项重要进展,为研究人员和从业者提供了一个强大工具,可在广泛场景中开发和评估 FL 算法。

英文摘要:

Federated learning (FL) has been widely adopted across various applications, such as healthcare, finance, and smart cities. However, as experimental scenarios become more complex, existing FL frameworks and benchmarks have struggled to keep pace. This paper introduces FedModule, a flexible and extensible FL experimental framework that has been open-sourced to support diverse FL paradigms and provide comprehensive benchmarks for complex experimental scenarios. FedModule adheres to the "one code, all scenarios" principle and employs a modular design that breaks the FL process into individual components, allowing for the seamless integration of different FL paradigms. The framework supports synchronous, asynchronous, and personalized federated learning, with over 20 implemented algorithms. Experiments conducted on public datasets demonstrate the flexibility and extensibility of FedModule. The framework offers multiple execution modes-including linear, threaded, process-based, and distributed-enabling users to tailor their setups to various experimental needs. Additionally, FedModule provides extensive logging and testing capabilities, which facilitate detailed performance analysis of FL algorithms. Comparative evaluations against existing FL toolkits, such as TensorFlow Federated, PySyft, Flower, and FLGo, highlight FedModule's superior scalability, flexibility, and comprehensive benchmark support. By addressing the limitations of current FL frameworks, FedModule marks a significant advancement in FL experimentation, providing researchers and practitioners with a robust tool for developing and evaluating FL algorithms across a wide range of scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑