MGIC:一种基于Canny边缘检测的联邦学习多标签梯度反演攻击
MGIC: A Multi-Label Gradient Inversion Attack based on Canny Edge Detection on Federated Learning
AI总结:
针对联邦学习梯度反演攻击中的语义错误与高时间成本问题,提出基于Canny边缘检测的多标签梯度反演方法MGIC,通过新增卷积层获取多标签以减少语义错误,在ImageNet上节省超78%时间成本。
摘要:
作为一种能够保护数据隐私的新型分布式计算框架,联邦学习(FL)近年来吸引了越来越多的关注。它从用户处接收梯度以训练全局模型,并将训练好的全局模型发布给工作用户。然而,梯度反演(GI)攻击反映了联邦学习中隐私泄露的风险。攻击者仅需通过数十万次简单迭代利用梯度,即可获得存储在用户本地设备上的相对准确的私有数据。为此,一些工作提出了简单但有效的策略,以在单标签数据集下获取用户数据。然而,这些策略以更高的时间成本为代价,获得了反演图像令人满意的视觉效果。由于单一标签的语义限制,通过梯度反演获得的图像可能产生语义错误。我们提出了一种基于Canny边缘检测的新型梯度反演策略(MGIC),适用于多标签和单标签数据集。为了减少单一标签引起的语义错误,我们在训练好的模型中添加了新的卷积层块,以获取图像的多标签信息。通过多标签表示,反演图像中的严重语义错误得以减少。随后,我们分析了参数对输入图像重建难度的影响,并讨论了图像多主体如何影响反演性能。我们提出的策略比最广泛使用的策略具有更好的视觉反演图像结果,在ImageNet数据集上节省了超过78%的时间成本。
英文摘要:
As a new distributed computing framework that can protect data privacy, federated learning (FL) has attracted more and more attention in recent years. It receives gradients from users to train the global model and releases the trained global model to working users. Nonetheless, the gradient inversion (GI) attack reflects the risk of privacy leakage in federated learning. Attackers only need to use gradients through hundreds of thousands of simple iterations to obtain relatively accurate private data stored on users' local devices. For this, some works propose simple but effective strategies to obtain user data under a single-label dataset. However, these strategies induce a satisfactory visual effect of the inversion image at the expense of higher time costs. Due to the semantic limitation of a single label, the image obtained by gradient inversion may have semantic errors. We present a novel gradient inversion strategy based on canny edge detection (MGIC) in both the multi-label and single-label datasets. To reduce semantic errors caused by a single label, we add new convolution layers' blocks in the trained model to obtain the image's multi-label. Through multi-label representation, serious semantic errors in inversion images are reduced. Then, we analyze the impact of parameters on the difficulty of input image reconstruction and discuss how image multi-subjects affect the inversion performance. Our proposed strategy has better visual inversion image results than the most widely used ones, saving more than 78% of time costs in the ImageNet dataset.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。