Classification-Head Bias in Class-Level Machine Unlearning: Diagnosis, Mitigation, and Evaluation
School of Computer Science and Cyber Engineering, Guangzhou University(计算机科学与电子工程学院,广州大学);School of Artificial Intelligence, Guangzhou University(人工智能学院,广州大学);Guangzhou Institute of Internet of Things(广州物联网研究院)
Class-level machine unlearning aims to remove the influence of specified classes while preserving model utility on retained classes. Existing methods are commonly evaluated by retain-set accuracy, forget-set accuracy, and unlearning time, but these metrics provide limited insight into how forgetting is achieved internally. In this paper, we reveal a bias-dominated shortcut in class-level unlearning: the prediction of forgotten classes can be suppressed by decreasing the corresponding bias terms in the final classification head. We first analyze the gradient dynamics of classification-head biases under softmax cross-entropy training, explaining why retain-set-only optimization tends to reduce the biases of absent classes. Based on this observation, we introduce BiasShift as a diagnostic baseline, showing that simple bias manipulation can satisfy conventional unlearning metrics while leaving abnormal bias patterns that reveal forgotten labels. To mitigate excessive forgotten-class bias suppression, we propose two bias-aware mechanisms, namely Two-Stage Bias Gradient Reversal Mechanism (TS-BGRM) and Lower-Bound Hinge Regularization (LB-HR). We further introduce three bias-oriented metrics, including Bias Stability Coefficient (BSC), Median Bias Gap (MBG), and Minimal Bias Score (MBS), to quantify bias dependence and potential leakage. Experiments on CIFAR-10, CIFAR-100, and Tiny-ImageNet demonstrate that the proposed methods maintain competitive unlearning performance while producing more stable bias distributions. We have released our code at {https://github.com/zwd2024/Beyond-the-Shadow-of-Bias-From-Classification-Head-Bias-to-Parameter-Redistribution}.
University of Chicago(芝加哥大学);Argonne National Laboratory(阿贡国家实验室);Lawrence Berkeley National Laboratory(劳伦斯伯克利国家实验室);Dartmouth College(达特茅斯学院);International Computer Science Institute(国际计算机科学研究所);University of California, Berkeley(加州大学伯克利分校)
Federated Unlearning with Gradient Descent and Conflict Mitigation
The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Guangzhou University(广州大学);The Shenzhen Institute of Artificial Intelligence and Robotics for Society(深圳人工智能与机器人研究院);University of Michigan(密歇根大学);Shenzhen Research Institute of Big Data(深圳大数据研究院)
Department of Electrical Engineering and Computer Science University of California Irvine(电气工程与计算机科学系加州大学伊维特分校);Department of Electrical and Computer Engineering University of Rochester(电气与计算机工程系罗切斯特大学)
Fusing Pruned and Backdoored Models: Optimal Transport-based Data-free Backdoor Mitigation
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Shenzhen Research Institute of Big Data(深圳大数据研究院);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
Comparative assessment of fairness definitions and bias mitigation strategies in machine learning-based diagnosis of Alzheimer's disease from MR images
National Technical University of Athens(雅典国家技术大学);University of Pennsylvania(宾夕法尼亚大学)
Towards Trustworthy Audio Deepfake Detection: A Systematic Framework for Diagnosing and Mitigating Gender Bias
School of Computing, Wichita State University(维克托利亚州立大学计算机学院);Institut national de la recherche scientifique (INRS-EMT)(国家科学研究机构(INRS-EMT));INRS-UQO Mixed Research Unit on Cybersecurity(INRS-UQO网络安全混合研究单位)
Safety-Utility Conflicts Are Not Global: Surgical Alignment via Head-Level Diagnosis
Baidu Inc.(百度公司);School of Software and Microelectronics, Peking University(北京大学软件与微电子学院);School of Computer Science, Peking University(北京大学计算机学院);State Key Laboratory of AI Safety, Institute of Computing Technology, CAS(中国科学院计算技术研究所人工智能安全重点实验室)