arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2005.11901cs.DC
收藏

基于两阶段多方计算的隐私保护联邦学习

Two-Phase Multi-Party Computation Enabled Privacy-Preserving Federated Learning

Renuga Kanagavelu, Zengxiang Li, Juniarto Samsudin, Yechao Yang, Feng Yang, Rick Siow Mong Goh, Mervyn Cheah, Praewpiraya Wiwatphonthana, Khajonpong Akkarajitsa… 展开作者

Renuga Kanagavelu, Zengxiang Li, Juniarto Samsudin, Yechao Yang, Feng Yang, Rick Siow Mong Goh, Mervyn Cheah, Praewpiraya Wiwatphonthana, Khajonpong Akkarajitsakul, Shangguang Wangz

摘要:

全球各国一直在推动严格的法规,以保护收集的个人或私人数据。传统的集中式机器学习方法从最终用户或物联网设备收集数据,以便发现真实世界数据背后的见解,根据这些法规,对于许多数据驱动的行业应用程序来说可能是不可行的。一种新的机器学习方法,由谷歌创造,称为联邦学习(FL),使多个参与者能够集体训练机器学习模型,而无需直接交换数据。然而,最近的研究表明,仍然有可能利用共享模型来提取个人或机密数据。在本文中,我们提出了采用多方计算(MPC),以实现隐私保护的模型聚合的FL。MPC使能的模型聚合在一个对等的方式会产生高的通信开销,低的可扩展性。为了解决这个问题,作者提出了一个两阶段的机制:1)选举一个小型委员会,2)通过委员会向更多的参与者提供支持MPC的模型聚合服务。支持MPC的FL框架已集成到智能制造的物联网平台中。它使一组公司能够通过在自己的场所利用他们的互补数据集来集体训练高质量的模型,而不会损害隐私,相对于传统机器学习方法的模型准确性以及在通信成本和执行时间方面的执行效率。

英文摘要:

Countries across the globe have been pushing strict regulations on the protection of personal or private data collected. The traditional centralized machine learning method, where data is collected from end-users or IoT devices, so that it can discover insights behind real-world data, may not be feasible for many data-driven industry applications in light of such regulations. A new machine learning method, coined by Google as Federated Learning (FL) enables multiple participants to train a machine learning model collectively without directly exchanging data. However, recent studies have shown that there is still a possibility to exploit the shared models to extract personal or confidential data. In this paper, we propose to adopt Multi Party Computation (MPC) to achieve privacy-preserving model aggregation for FL. The MPC-enabled model aggregation in a peer-to-peer manner incurs high communication overhead with low scalability. To address this problem, the authors proposed to develop a two-phase mechanism by 1) electing a small committee and 2) providing MPC-enabled model aggregation service to a larger number of participants through the committee. The MPC enabled FL framework has been integrated in an IoT platform for smart manufacturing. It enables a set of companies to train high quality models collectively by leveraging their complementary data-sets on their own premises, without compromising privacy, model accuracy vis-a-vis traditional machine learning methods and execution efficiency in terms of communication cost and execution time.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑