VFL:一种可验证的保护隐私的工业大数据联邦学习方法IoT
VFL: A Verifiable Federated Learning with Privacy-Preserving for Big Data in Industrial IoT
摘要:
由于大数据强大的分析能力,深度学习在工业物联网中被广泛应用于对采集的数据进行训练。然而,对于隐私问题,传统的数据收集集中式学习并不适用于对训练集敏感的工业场景。最近,联邦学习受到了广泛的关注,因为它只依赖于梯度聚合而不访问训练集来训练模型。但已有的研究表明,共享梯度仍然保留了训练集的敏感信息。更糟糕的是,恶意聚合服务器可能返回伪造的聚合梯度。在本文中,我们提出了VFL,可验证的联邦学习与隐私保护的大数据在工业物联网。具体来说,我们使用拉格朗日插值精心设置插值点,以验证聚合梯度的正确性。与现有方案相比,VFL的验证开销保持不变,无论参与者的数量。此外,我们采用盲法技术来保护参与者提交的梯度的隐私。如果n个参与者中不超过n-2个参与者与聚合服务器勾结,则VFL可以保证其他参与者的加密梯度不被反转。实验评估证实了所提出的VFL框架具有高精度和高效率的实际性能。
英文摘要:
Due to the strong analytical ability of big data, deep learning has been widely applied to train the collected data in industrial IoT. However, for privacy issues, traditional data-gathering centralized learning is not applicable to industrial scenarios sensitive to training sets. Recently, federated learning has received widespread attention, since it trains a model by only relying on gradient aggregation without accessing training sets. But existing researches reveal that the shared gradient still retains the sensitive information of the training set. Even worse, a malicious aggregation server may return forged aggregated gradients. In this paper, we propose the VFL, verifiable federated learning with privacy-preserving for big data in industrial IoT. Specifically, we use Lagrange interpolation to elaborately set interpolation points for verifying the correctness of the aggregated gradients. Compared with existing schemes, the verification overhead of VFL remains constant regardless of the number of participants. Moreover, we employ the blinding technology to protect the privacy of the gradients submitted by the participants. If no more than n-2 of n participants collude with the aggregation server, VFL could guarantee the encrypted gradients of other participants not being inverted. Experimental evaluations corroborate the practical performance of the presented VFL framework with high accuracy and efficiency.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。