Certified machine unlearning ensures the proximity between the unlearned model and a model retrained without the data to be forgotten. Extending this framework to sequential deletion requests, typically arriving as groups of variable size (e.g., all records of one user or of coordinated users), is challenging. For unlearning methods based on fine-tuning on the retain sets, this leads to either degrading performance or increasing computation as the number of unlearning requests grows. For independent successive requests, we instead certify each model release against a counterfactual unlearning trajectory in which the group being deleted never took part. With a fixed fine-tuning budget per deletion, we show that, for smooth strongly convex objectives, this approach keeps the performance loss bounded, uniformly in the number of requests. Experiments with multiclass logistic regression on FEMNIST show that the resulting algorithm needs fewer corrective steps than existing sequential methods and outperforms training-time differential privacy, particularly when group sizes are heterogeneous.
Debiasing Machine Unlearning with Counterfactual Examples
Stony Brook University(石溪大学);Walmart Global Tech(沃尔玛全球科技);The Xi’an Jiaotong-Liverpool University(西交利物浦大学);Boise State University(博伊西州立大学);Indian Institute of Technology Hyderabad(印度理工学院海得拉巴分校);Sapienza University of Rome(罗马大学);Zhejiang University(浙江大学);Institute of semiconductors, Chinese Academy of Sciences(中国科学院半导体研究所)
Is Gradient Ascent Really Necessary? Memorize to Forget for Machine Unlearning
Sydney AI Centre, The University of Sydney(悉尼人工智能中心,悉尼大学);Hong Kong Baptist University(香港 Baptist 大学);RIKEN AIP(日本理化学研究所AIP);University of Technology Sydney(悉尼技术大学)
GUDA: Counterfactual Group-wise Training Data Attribution for Diffusion Models via Unlearning
University of Tokyo(东京大学);Toyota Central Research Laboratory(丰田中央研究所);University of California, Berkeley(加州大学伯克利分校);Massachusetts Institute of Technology(麻省理工学院);National Institute of Advanced Industrial Science and Technology(国家工业科学与技术研究院)