In recent years, the notion of ``the right to be forgotten" (RTBF) has become a crucial aspect of data privacy for digital trust and AI safety, requiring the provision of mechanisms that support the removal of personal data of individuals upon their requests. Consequently, machine unlearning (MU) has gained considerable attention which allows an ML model to selectively eliminate identifiable information. Evolving from MU, federated unlearning (FU) has emerged to confront the challenge of data erasure within federated learning (FL) settings, which empowers the FL model to unlearn an FL client or identifiable information pertaining to the client. Nevertheless, the distinctive attributes of federated learning introduce specific challenges for FU techniques. These challenges necessitate a tailored design when developing FU algorithms. While various concepts and numerous federated unlearning schemes exist in this field, the unified workflow and tailored design of FU are not yet well understood. Therefore, this comprehensive survey delves into the techniques and methodologies in FU providing an overview of fundamental concepts and principles, evaluating existing federated unlearning algorithms, and reviewing optimizations tailored to federated learning. Additionally, it discusses practical applications and assesses their limitations. Finally, it outlines promising directions for future research.
Client-Verifiable and Efficient Federated Unlearning in Low-Altitude Wireless Networks
Beijing Institute of Technology(北京理工大学);Qilu University of Technology (Shandong Academy of Sciences)(齐鲁工业大学(山东省科学院));Hefei University of Technology(合肥工业大学);Zhongguancun Rongzhi Enterprise Management Innovation Promotion Center(中关村荣智企业管理创新促进中心)
Forgetting to Witness: Efficient Federated Unlearning and Its Visible Evaluation
School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);King Abdullah University of Science and Technology(阿卜杜拉国王科技大学)
State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications(网络与交换技术国家重点实验室,北京邮电大学);School of Computer Science and Engineering, Nanyang Technological University(南洋理工大学计算机科学与工程学院);The Future Network of Intelligence Institute, The Chinese University of Hong Kong (Shenzhen)(香港中文大学(深圳)未来智联网络研究院);School of Science and Engineering, The Chinese University of Hong Kong (Shenzhen)(香港中文大学(深圳)理工学院)
Poisoning Attacks and Defenses to Federated Unlearning
ShanghaiTech University(上海科技大学);Xidian University(西安电子科技大学);North Carolina State University(北卡罗来纳州立大学);University of North Texas(北德克萨斯大学);University of Louisville(路易斯维尔大学)
Certifying the Right to Be Forgotten: Primal-Dual Optimization for Sample and Label Unlearning in Vertical Federated Learning
College of Computing and Data Science (CCDS), Nanyang Technological University, Singapore and Digital Trust Centre (DTC), Singapore(南洋理工大学计算与数据科学学院(CCDS)及新加坡数字信任中心(DTC));College of Computing and Data Science (CCDS), Nanyang Technological University, Singapore(南洋理工大学计算与数据科学学院(CCDS));School of Computer Science and Engineering, Sun Yat-sen University(中山大学计算机科学与工程学院)
BlockFUL: Enabling Unlearning in Blockchained Federated Learning
Information Security Center, State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications(信息安全部,网络与交换技术国家重点实验室,北京邮电大学);Global Big Data Technologies Centre, University of Technology Sydney(大数据技术中心,悉尼大学)
Scalable Federated Unlearning via Isolated and Coded Sharding
Beijing University of Posts and Telecommunications(北京邮电大学);The Chinese University of Hong Kong (Shenzhen)(香港中文大学(深圳));Nanyang Technological University(南洋理工大学);Central South University(中南大学)
The Right to be Forgotten in Federated Learning: An Efficient Realization with Rapid Retraining
City University of Hong Kong(香港城市大学);Nanjing University of Science and Technology(南京理工大学);Monash University(莫纳什大学);The Hong Kong University of Science and Technology(香港科技大学)
在机器学习中,\textit{the right to be forgotten}的出现催生了一个名为\textit{machine unlearning}的范式,该范式使数据持有者能够主动从训练模型中删除其数据。现有的机器遗忘技术集中于集中式训练,其中访问所有持有者的训练数据是服务器进行遗忘过程所必须的。当无法完全访问所有训练数据时,如何实现遗忘,这在很大程度上还有待探索。一个值得注意的例子是联邦学习(FL),其中每个参与的数据持有者在本地进行训练,而不将其训练数据共享给中央服务器。本文研究了FL系统中的机器遗忘问题。我们从FL中的非学习问题的正式定义开始,并提出了一种快速的再训练方法来完全删除训练FL模型中的数据样本。由此产生的设计允许数据持有者有效地联合进行遗忘过程,同时将其训练数据保持在本地。我们的形式收敛性和复杂性分析表明,我们的设计可以保持高效率的模型效用。在四个真实世界的数据集上进行了广泛的评估,说明了我们提出的实现的有效性和性能。
Federated Unlearning with Gradient Descent and Conflict Mitigation
The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Guangzhou University(广州大学);The Shenzhen Institute of Artificial Intelligence and Robotics for Society(深圳人工智能与机器人研究院);University of Michigan(密歇根大学);Shenzhen Research Institute of Big Data(深圳大数据研究院)
FRAMU: Attention-based Machine Unlearning using Federated Reinforcement Learning
University of Southern Queensland(南昆士兰大学);Wuhan University of Technology(武汉理工大学);Lingnan University(岭南大学);University of Electronic Science and Technology of China(电子科技大学);Hong Kong Polytechnic University(香港理工大学)
Goldfish: An Efficient Federated Unlearning Framework
School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);King Abdullah University of Science and Technology(阿卜杜拉国王科技大学)
Data Duplication: A Novel Multi-Purpose Attack Paradigm in Machine Unlearning
University of Technology Sydney(新南威尔士大学);City University of Macau(澳门城市大学);Griffith University(格里菲斯大学);CISPA Helmholtz Center for Information Security(信息安全霍普夫研究中心)
BlindU: Blind Machine Unlearning without Revealing Erasing Data
School of Computer Science, University of Technology Sydney(计算机科学学院,技术悉尼大学);School of Cyber Science and Engineering, Southeast University(网络科学与工程学院,东南大学)
UnlearnShield: Shielding Forgotten Privacy against Unlearning Inversion
Huazhong University of Science and Technology(华中科技大学);Institute of Guizhou Aerospace Measuring and Testing Technology(贵州航天测量测试技术研究院);University of Technology Sydney(悉尼科技大学);Griffith University(格里菲斯大学)
Causal Unlearning in Collaborative Optimization: Exact and Approximate Influence Reversal under Adversarial Contributions
Department of Computer Engineering, SRC, Islamic Azad University Tehran, Iran(伊朗伊斯兰Azad大学塔希尔分校计算机工程系);School of Computer Engineering, Iran University of Science and Technology Tehran, Iran(伊朗科学技术大学塔希尔分校计算机工程系);Meta CA, USA(美国Meta公司)
Machine Unlearning: Taxonomy, Metrics, Applications, Challenges, and Prospects
Nanjing University of Science and Technology(南京理工大学);Xidian University(西安电子科技大学);CSIRO(联邦科学与工业研究组织);University of Western Australia(西澳大学);University of Technology Sydney(悉尼科技大学)