arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2202.03672cs.LG
收藏

APPFL:用于隐私保护的联邦学习开源软件框架

APPFL: Open-Source Software Framework for Privacy-Preserving Federated Learning

Argonne National Laboratory(阿贡国家实验室)

Minseok Ryu, Youngdae Kim, Kibaek Kim, Ravi K. Madduri

摘要:

联邦学习(FL)能够在不同的站点训练模型并更新训练的权重,而不是像经典的机器学习那样将数据传输到中心位置并进行训练。FL能力对于生物医学和智能电网等领域尤其重要,因为这些领域的数据可能无法自由共享或存储在中央位置。由于能够从分散的数据集中学习,FL现在是一个快速发展的研究领域,并且已经开发了许多FL框架。在这项工作中,我们介绍APPFL,阿贡隐私保护联邦学习框架。APPFL允许用户利用已实现的隐私保护算法,实现新算法,并使用隐私保护技术模拟和部署各种FL算法。模块化框架使用户能够定制算法、隐私、通信协议、神经网络模型和用户数据的组件。我们还提出了一个新的通信效率的算法的基础上的不精确交替方向方法的乘法器。该算法需要显着减少服务器和客户端之间的通信比目前的最先进的。我们证明了APPFL的计算能力,包括不同的私人FL在各种测试数据集和其可扩展性,通过使用多个算法和数据集在不同的计算环境。

英文摘要:

Federated learning (FL) enables training models at different sites and updating the weights from the training instead of transferring data to a central location and training as in classical machine learning. The FL capability is especially important to domains such as biomedicine and smart grid, where data may not be shared freely or stored at a central location because of policy challenges. Thanks to the capability of learning from decentralized datasets, FL is now a rapidly growing research field, and numerous FL frameworks have been developed. In this work, we introduce APPFL, the Argonne Privacy-Preserving Federated Learning framework. APPFL allows users to leverage implemented privacy-preserving algorithms, implement new algorithms, and simulate and deploy various FL algorithms with privacy-preserving techniques. The modular framework enables users to customize the components for algorithms, privacy, communication protocols, neural network models, and user data. We also present a new communication-efficient algorithm based on an inexact alternating direction method of multipliers. The algorithm requires significantly less communication between the server and the clients than does the current state of the art. We demonstrate the computational capabilities of APPFL, including differentially private FL on various test datasets and its scalability, by using multiple algorithms and datasets on different computing environments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑