Debiasing Machine Unlearning with Counterfactual Examples
Stony Brook University(石溪大学);Walmart Global Tech(沃尔玛全球科技);The Xi’an Jiaotong-Liverpool University(西交利物浦大学);Boise State University(博伊西州立大学);Indian Institute of Technology Hyderabad(印度理工学院海得拉巴分校);Sapienza University of Rome(罗马大学);Zhejiang University(浙江大学);Institute of semiconductors, Chinese Academy of Sciences(中国科学院半导体研究所)
Ziheng Chen, Jia Wang, Jun Zhuang, Abbavaram Gowtham Reddy, Fabrizio Silvestri, Jin Huang, Kaushiki Nag, Kun Kuang, Xin Ning, Gabriele Tolomei
The right to be forgotten (RTBF) seeks to safeguard individuals from the enduring effects of their historical actions by implementing machine-learning techniques. These techniques facilitate the deletion of previously acquired knowledge without requiring extensive model retraining. However, they often overlook a critical issue: unlearning processes bias. This bias emerges from two main sources: (1) data-level bias, characterized by uneven data removal, and (2) algorithm-level bias, which leads to the contamination of the remaining dataset, thereby degrading model accuracy. In this work, we analyze the causal factors behind the unlearning process and mitigate biases at both data and algorithmic levels. Typically, we introduce an intervention-based approach, where knowledge to forget is erased with a debiased dataset. Besides, we guide the forgetting procedure by leveraging counterfactual examples, as they maintain semantic data consistency without hurting performance on the remaining dataset. Experimental results demonstrate that our method outperforms existing machine unlearning baselines on evaluation metrics.
Is Gradient Ascent Really Necessary? Memorize to Forget for Machine Unlearning
Sydney AI Centre, The University of Sydney(悉尼人工智能中心,悉尼大学);Hong Kong Baptist University(香港 Baptist 大学);RIKEN AIP(日本理化学研究所AIP);University of Technology Sydney(悉尼技术大学)
Enabling Group Fairness in Graph Unlearning via Bi-level Debiasing
Department of Electrical Engineering and Computer Science, University of California, Irvine(电气工程与计算机科学系,加州大学伊尔凡分校);Donald Bren School of Information and Computer Sciences, University of California, Irvine(戴维·布伦信息与计算机科学学院,加州大学伊尔凡分校)
GUDA: Counterfactual Group-wise Training Data Attribution for Diffusion Models via Unlearning
University of Tokyo(东京大学);Toyota Central Research Laboratory(丰田中央研究所);University of California, Berkeley(加州大学伯克利分校);Massachusetts Institute of Technology(麻省理工学院);National Institute of Advanced Industrial Science and Technology(国家工业科学与技术研究院)
Academy for Engineering and Technology, Fudan University(复旦大学工程与技术学院);Jilin Provincial Key Laboratory of Intelligence Science and Engineering(吉林省智能科学与工程重点实验室);Engineering Research Center of AI and Robotics, Ministry of Education(教育部人工智能与机器人工程研究中心)
The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Zhejiang University(浙江大学);University of Sydney(悉尼大学);Northwestern University(西北大学);Analogy AI, Inc.(Analogy AI公司);Mohamed Bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学)
BPL: Bias-adaptive Preference Distillation Learning for Recommender System
Department of Computer Science and Engineering, Korea University(计算机科学与工程系,韩国大学);Microsoft Research Asia(微软亚洲研究院);Department of Aritifial Intelligence, Yonsei University(人工智能系,延世大学);Department of Computer Science and Engineering, POSTECH(计算机科学与工程系,POSTECH);William & Mary(威廉与玛丽学院)
Towards Understanding Gender Bias in Relation Extraction
Department of Computer Science, UC Santa Barbara(加州大学圣塔芭芭拉分校计算机科学系);Department of Computer Science, UC Los Angeles(加州大学洛杉矶分校计算机科学系);School of Interactive Computing, Georgia Institute of Technology(佐治亚理工学院交互计算学院)