arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2108.04551cs.LGcs.AIcs.CRcs.DC
收藏

ABC-FL:联邦学习中的异常和良性客户端分类

ABC-FL: Anomalous and Benign client Classification in Federated Learning

Sungkyunkwan University(成均馆大学)

Hyejun Jeong, Joonyong Hwang, Tai Myung Chung

摘要:

联邦学习是一种分布式机器学习框架,设计用于数据隐私保护,即,本地数据在整个训练和测试过程中保持私有。联邦学习越来越受欢迎,因为它允许人们在保护隐私的同时使用机器学习技术。然而,它继承了深度学习技术中提出的漏洞和不确定性。例如,联邦学习特别容易受到数据投毒攻击,由于其分布式特性和无法访问原始数据,这些攻击可能会降低其性能和完整性。此外,由于非独立和/或相同分布(非IID)数据,正确识别恶意客户端非常困难。真实世界的数据可能是复杂和多样的,使得它们在没有对原始数据的直接存取的情况下很难与恶意数据区分开来。先前的研究集中在检测恶意客户端,而仅将具有IID数据的客户端视为良性。在这项研究中,我们提出了一种方法,从良性客户端检测和分类异常客户端时,良性的非IID数据。我们提出的方法利用特征降维,动态聚类和基于余弦相似性的裁剪。实验结果表明,该方法不仅可以对恶意客户端进行分类,而且可以从整个过程中消除恶意客户端的负面影响。我们的研究结果可以用于未来的研究,以有效地消除异常客户端时,建立一个模型与不同的数据。

英文摘要:

Federated Learning is a distributed machine learning framework designed for data privacy preservation i.e., local data remain private throughout the entire training and testing procedure. Federated Learning is gaining popularity because it allows one to use machine learning techniques while preserving privacy. However, it inherits the vulnerabilities and susceptibilities raised in deep learning techniques. For instance, Federated Learning is particularly vulnerable to data poisoning attacks that may deteriorate its performance and integrity due to its distributed nature and inaccessibility to the raw data. In addition, it is extremely difficult to correctly identify malicious clients due to the non-Independently and/or Identically Distributed (non-IID) data. The real-world data can be complex and diverse, making them hardly distinguishable from the malicious data without direct access to the raw data. Prior research has focused on detecting malicious clients while treating only the clients having IID data as benign. In this study, we propose a method that detects and classifies anomalous clients from benign clients when benign ones have non-IID data. Our proposed method leverages feature dimension reduction, dynamic clustering, and cosine similarity-based clipping. The experimental results validates that our proposed method not only classifies the malicious clients but also alleviates their negative influences from the entire procedure. Our findings may be used in future studies to effectively eliminate anomalous clients when building a model with diverse data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑