As the use of machine learning (ML) models is becoming increasingly popular in many real-world applications, there are practical challenges that need to be addressed for model maintenance. One such challenge is to 'undo' the effect of a specific subset of dataset used for training a model. This specific subset may contain malicious or adversarial data injected by an attacker, which affects the model performance. Another reason may be the need for a service provider to remove data pertaining to a specific user to respect the user's privacy. In both cases, the problem is to 'unlearn' a specific subset of the training data from a trained model without incurring the costly procedure of retraining the whole model from scratch. Towards this goal, this paper presents a Markov chain Monte Carlo-based machine unlearning (MCU) algorithm. MCU helps to effectively and efficiently unlearn a trained model from subsets of training dataset. Furthermore, we show that with MCU, we are able to explain the effect of a subset of a training dataset on the model prediction. Thus, MCU is useful for examining subsets of data to identify the adversarial data to be removed. Similarly, MCU can be used to erase the lineage of a user's personal data from trained ML models, thus upholding a user's "right to be forgotten". We empirically evaluate the performance of our proposed MCU algorithm on real-world phishing and diabetes datasets. Results show that MCU can achieve a desirable performance by efficiently removing the effect of a subset of training dataset and outperform an existing algorithm that utilizes the remaining dataset.
The Right to be Forgotten in Federated Learning: An Efficient Realization with Rapid Retraining
City University of Hong Kong(香港城市大学);Nanjing University of Science and Technology(南京理工大学);Monash University(莫纳什大学);The Hong Kong University of Science and Technology(香港科技大学)
在机器学习中,\textit{the right to be forgotten}的出现催生了一个名为\textit{machine unlearning}的范式,该范式使数据持有者能够主动从训练模型中删除其数据。现有的机器遗忘技术集中于集中式训练,其中访问所有持有者的训练数据是服务器进行遗忘过程所必须的。当无法完全访问所有训练数据时,如何实现遗忘,这在很大程度上还有待探索。一个值得注意的例子是联邦学习(FL),其中每个参与的数据持有者在本地进行训练,而不将其训练数据共享给中央服务器。本文研究了FL系统中的机器遗忘问题。我们从FL中的非学习问题的正式定义开始,并提出了一种快速的再训练方法来完全删除训练FL模型中的数据样本。由此产生的设计允许数据持有者有效地联合进行遗忘过程,同时将其训练数据保持在本地。我们的形式收敛性和复杂性分析表明,我们的设计可以保持高效率的模型效用。在四个真实世界的数据集上进行了广泛的评估,说明了我们提出的实现的有效性和性能。
Certifying the Right to Be Forgotten: Primal-Dual Optimization for Sample and Label Unlearning in Vertical Federated Learning
College of Computing and Data Science (CCDS), Nanyang Technological University, Singapore and Digital Trust Centre (DTC), Singapore(南洋理工大学计算与数据科学学院(CCDS)及新加坡数字信任中心(DTC));College of Computing and Data Science (CCDS), Nanyang Technological University, Singapore(南洋理工大学计算与数据科学学院(CCDS));School of Computer Science and Engineering, Sun Yat-sen University(中山大学计算机科学与工程学院)
From Machine Learning to Machine Unlearning: Complying with GDPR's Right to be Forgotten while Maintaining Business Value of Predictive Models
Shanghai University of Finance and Economics(上海财经大学);Beihang University(北京航空航天大学);Hefei University of Technology(合肥工业大学);University of South Florida(南佛罗里达大学);University of Maryland(马里兰大学)
Classification-Head Bias in Class-Level Machine Unlearning: Diagnosis, Mitigation, and Evaluation
School of Computer Science and Cyber Engineering, Guangzhou University(计算机科学与电子工程学院,广州大学);School of Artificial Intelligence, Guangzhou University(人工智能学院,广州大学);Guangzhou Institute of Internet of Things(广州物联网研究院)
Towards Efficient Target-Level Machine Unlearning Based on Essential Graph
University of Technology Sydney(悉尼科技大学);City University of Macau(澳门城市大学);Shenzhen Institute of Advanced Technology, University of Chinese Academy of Sciences(中国科学院大学深圳先进技术研究院)
Machine Unlearning: Taxonomy, Metrics, Applications, Challenges, and Prospects
Nanjing University of Science and Technology(南京理工大学);Xidian University(西安电子科技大学);CSIRO(联邦科学与工业研究组织);University of Western Australia(西澳大学);University of Technology Sydney(悉尼科技大学)
Auditing Language Model Unlearning via Information Decomposition
Technical University of Darmstadt(达姆施塔特工业大学);National Research Center for Applied Cybersecurity ATHENE(ATHENE国家应用网络安全研究中心);Georgia Institute of Technology(佐治亚理工学院)
TruVRF: Towards Triple-Granularity Verification on Machine Unlearning
School of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);School of Computer Science and Engineering, Nanjing University of Science and Technology(南京理工大学计算机科学与工程学院)
University of Virginia(弗吉尼亚大学);University of Lausanne(洛桑大学);CISPA Helmholtz Center for Information Security(CISPA亥姆霍兹信息安全中心);Carnegie Mellon University(卡内基梅隆大学);Purdue University(普渡大学)
FaLW: A Forgetting-aware Loss Reweighting for Long-tailed Unlearning
University of Science and Technology of China(USTC)(中国科学技术大学);Suzhou Institute for Advanced Research, USTC(中国科学技术大学苏州研究院);City University of Hong Kong(香港城市大学);Tongji University(同济大学)
Distribution-Guided and Constrained Quantum Machine Unlearning
Department of Electrical Engineering, Lahore University of Management Sciences, Lahore 54792, Pakistan.(电气工程系,拉合尔管理科学大学,巴基斯坦拉合尔);Department of Physics, Lahore University of Management Sciences, Lahore 54792, Pakistan.(物理系,拉合尔管理科学大学,巴基斯坦拉合尔)
Langevin Unlearning: A New Perspective of Noisy Gradient Descent for Machine Unlearning
Department of Electrical and Computer Engineering(电气与计算机工程系);Georgia Institute of Technology(佐治亚理工学院);Department of Mathematics(数学系);Massachusetts Institute of Technology(麻省理工学院)
FROC: A Unified Framework with Risk-Optimized Control for Machine Unlearning in LLMs
Digital Trust Centre, Nanyang Technological University, Singapore(南洋理工大学数字信任中心);College of Computing and Data Science, Nanyang Technological University, Singapore(南洋理工大学计算与数据科学学院)