arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2301.09508cs.LGcs.AI
收藏

BayBFed:用于联邦学习的贝叶斯后门防御

BayBFed: Bayesian Backdoor Defense for Federated Learning

Technical University of Darmstadt(达姆施塔特工业大学);The University of Texas at San Antonio(德克萨斯大学圣安东尼奥分校)

Kavita Kumari, Phillip Rieger, Hossein Fereidooni, Murtuza Jadliwala, Ahmad-Reza Sadeghi

摘要:

联邦学习(FL)允许参与者联合训练机器学习模型,而无需与他人共享他们的私人数据。然而,FL容易受到中毒攻击,例如后门攻击。因此,最近已经提出了各种防御,其主要利用全局模型的中间状态(即,logits)或局部模型的距离(即,L2-norm)从全局模型中检测恶意后门。然而,由于这些方法直接对客户端更新进行操作,因此其有效性取决于客户端的数据分布或对手的攻击策略等因素。在本文中,我们介绍了一种新的,更通用的后门防御框架,称为BayBFed,它建议利用客户端更新的概率分布来检测FL中的恶意更新:它计算客户端更新上的概率度量以跟踪更新中所做的任何调整,并使用一种新颖的检测算法,该算法可以利用这种概率测量来有效地检测和过滤恶意更新。因此,它克服了由于直接使用客户端更新而产生的先前方法的缺点;因为我们的概率度量将包括本地客户端培训策略的所有方面。BayBFed利用两个贝叶斯非参数扩展:(i)分层Beta-Bernoulli过程,以在给定客户端更新的情况下绘制概率度量,以及(ii)中国餐馆过程(CRP)的改编,我们称为CRP-Jensen,它利用此概率度量来检测和过滤恶意更新。我们在五个基准数据集上广泛评估了我们的防御方法:CIFAR 10,Reddit,物联网入侵检测,MNIST和FMNIST,并表明它可以有效地检测和消除FL中的恶意更新,而不会降低全局模型的良性性能。

英文摘要:

Federated learning (FL) allows participants to jointly train a machine learning model without sharing their private data with others. However, FL is vulnerable to poisoning attacks such as backdoor attacks. Consequently, a variety of defenses have recently been proposed, which have primarily utilized intermediary states of the global model (i.e., logits) or distance of the local models (i.e., L2-norm) from the global model to detect malicious backdoors. However, as these approaches directly operate on client updates, their effectiveness depends on factors such as clients' data distribution or the adversary's attack strategies. In this paper, we introduce a novel and more generic backdoor defense framework, called BayBFed, which proposes to utilize probability distributions over client updates to detect malicious updates in FL: it computes a probabilistic measure over the clients' updates to keep track of any adjustments made in the updates, and uses a novel detection algorithm that can leverage this probabilistic measure to efficiently detect and filter out malicious updates. Thus, it overcomes the shortcomings of previous approaches that arise due to the direct usage of client updates; as our probabilistic measure will include all aspects of the local client training strategies. BayBFed utilizes two Bayesian Non-Parametric extensions: (i) a Hierarchical Beta-Bernoulli process to draw a probabilistic measure given the clients' updates, and (ii) an adaptation of the Chinese Restaurant Process (CRP), referred by us as CRP-Jensen, which leverages this probabilistic measure to detect and filter out malicious updates. We extensively evaluate our defense approach on five benchmark datasets: CIFAR10, Reddit, IoT intrusion detection, MNIST, and FMNIST, and show that it can effectively detect and eliminate malicious updates in FL without deteriorating the benign performance of the global model.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑