Machine unlearning is a crucial tool for enabling a classification model to forget specific data that are used in the training time. Recently, various studies have presented machine unlearning algorithms and evaluated their methods on several datasets. However, most of the current machine unlearning algorithms have been evaluated solely on traditional computer vision datasets such as CIFAR-10, MNIST, and SVHN. Furthermore, previous studies generally evaluate the unlearning methods in the class-unlearning setup. Most previous work first trains the classification models and then evaluates the machine unlearning performance of machine unlearning algorithms by forgetting selected image classes (categories) in the experiments. Unfortunately, these class-unlearning settings might not generalize to real-world scenarios. In this work, we propose a machine unlearning setting that aims to unlearn specific instance that contains personal privacy (identity) while maintaining the original task of a given model. Specifically, we propose two machine unlearning benchmark datasets, MUFAC and MUCAC, that are greatly useful to evaluate the performance and robustness of a machine unlearning algorithm. In our benchmark datasets, the original model performs facial feature recognition tasks: face age estimation (multi-class classification) and facial attribute classification (binary class classification), where a class does not depend on any single target subject (personal identity), which can be a realistic setting. Moreover, we also report the performance of the state-of-the-art machine unlearning methods on our proposed benchmark datasets. All the datasets, source codes, and trained models are publicly available at https://github.com/ndb796/MachineUnlearning.
Benchmarking Vision Language Model Unlearning via Fictitious Facial Identity Dataset
University of Wisconsin-Madison(威斯康星大学麦迪逊分校);USC(南加州大学);University of Michigan-Ann Arbor(密歇根大学安娜堡分校);University of Washington(华盛顿大学);University of Maryland(马里兰大学);Lehigh University(理海大学);UIUC(伊利诺伊大学厄巴纳-香槟分校);Peking University(北京大学);University of Rochester(罗切斯特大学);University of California, Davis(加州大学戴维斯分校)
SafeEraser: Enhancing Safety in Multimodal Large Language Models through Multimodal Machine Unlearning
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));The Hong Kong University of Science and Technology(香港科技大学);Southeast University(东南大学);Ant Group, Alibaba(蚂蚁集团)
Are We Truly Forgetting? A Critical Re-examination of Machine Unlearning Evaluation Protocols
Department of Artificial Intelligence, Korea University, South Korea(韩国大学人工智能系);Computer Science Dept. at Courant Institute of Mathemtical Sciences, New York University, United States(纽约大学Courant数学科学研究所计算机科学系)
Bias Redistribution in Visual Machine Unlearning: Does Forgetting One Group Harm Another?
NewraLab;Beihang University(北京航空航天大学);GoerTek Alpha Lab(歌尔Alpha实验室);Skyline University Nigeria(尼日利亚天际线大学);UESTC(电子科技大学);Imperial College London(帝国理工学院)
Train Once, Forget Precisely: Anchored Optimization for Efficient Post-Hoc Unlearning
University College London, London, United Kingdom(伦敦大学学院);University of Nottingham, Nottingham, United Kingdom(诺丁汉大学);Bharati Vidyapeeth College of Engineering, New Delhi, India(巴里蒂大学工程学院)
Forget-MI: Machine Unlearning for Forgetting Multimodal Information in Healthcare Settings
Department of Machine Learning, Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, UAE Department of Computer Vision, Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, UAE Department of Computer Science, Michigan State University, United States 0.2cm
ReLearn: Unlearning via Learning for Large Language Models
Zhejiang University(浙江大学);Xiamen University(厦门大学);Tsinghua University(清华大学);Harbin Institute of Technology(哈尔滨工业大学);National University of Singapore(新加坡国立大学);NUS-NCS Joint Lab(新加坡国立大学-新科系统联合实验室)
针对现有大模型遗忘方法破坏文本连贯性与评估指标不足的问题,提出数据增强微调流水线 ReLearn 及包含 KFR、KRR 和 LS 的综合评估框架,实现了高效目标遗忘并保持高质量生成。