arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.02017cs.CR
收藏

在联邦学习中防止源推断攻击

Protection against Source Inference Attacks in Federated Learning

TU Delft(代尔夫特理工大学);Inria(法国国家信息与自动化研究所);IPP(巴黎高等师范学院信息处理研究所)

Andreas Athanasiou, Kangsoo Jung, Catuscia Palamidessi

AI总结:

本文提出了一种基于参数级洗牌与残差数系统的新方法,有效防止联邦学习中的源推断攻击,同时保持模型准确性。

摘要:

联邦学习(FL)最初被提出作为一种保护隐私的机器学习范式。然而,FL已被证明容易受到一系列隐私攻击的侵害。最近,人们对源推断攻击(SIA)表示了担忧,其中诚实但好奇的中央服务器试图确定哪个客户端拥有用于训练阶段的特定数据点。令人震惊的是,标准梯度模糊技术与差分隐私已被证明在没有严重降低准确性的情况下对SIA无效。在本工作中,我们提出了一种在广泛研究的shuffle模型中防止SIA的防御方法,其中诚实的洗牌者充当客户端和服务器之间的中介。首先,我们证明了标准的简单洗牌本身不足以防止SIA。为了有效防御SIA,洗牌需要在更细粒度的层面进行应用;我们提出了一种新颖的参数级洗牌与残差数系统(RNS)的组合。我们的方法在不影响联合模型准确性的情况下提供了对SIA的稳健保护,并且可以无缝集成到其他隐私保护机制中。我们在一系列模型和数据集上进行了实验,证实了标准洗牌方法无法防止SIA,而相比之下,我们提出的方法将攻击的准确性降低到随机猜测的水平。

英文摘要:

Federated Learning (FL) was initially proposed as a privacy-preserving machine learning paradigm. However, FL has been shown to be susceptible to a series of privacy attacks. Recently, there has been concern about the Source Inference Attack (SIA), where an honest-but-curious central server attempts to identify exactly which client owns a given data point which was used in the training phase. Alarmingly, standard gradient obfuscation techniques with Differential Privacy have been shown to be ineffective against SIAs, at least without severely diminishing the accuracy. In this work, we propose a defense against SIAs within the widely studied shuffle model of FL, where an honest shuffler acts as an intermediary between the clients and the server. First, we demonstrate that standard naive shuffling alone is insufficient to prevent SIAs. To effectively defend against SIAs, shuffling needs to be applied at a more granular level; we propose a novel combination of parameter-level shuffling with the residue number system (RNS). Our approach provides robust protection against SIAs without affecting the accuracy of the joint model and can be seamlessly integrated into other privacy protection mechanisms. We conduct experiments on a series of models and datasets, confirming that standard shuffling approaches fail to prevent SIAs and that, in contrast, our proposed method reduce the attack's accuracy to the level of random guessing.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑