Recommender systems provide essential web services by learning users' personal preferences from collected data. However, in many cases, systems also need to forget some training data. From the perspective of privacy, several privacy regulations have recently been proposed, requiring systems to eliminate any impact of the data whose owner requests to forget. From the perspective of utility, if a system's utility is damaged by some bad data, the system needs to forget these data to regain utility. From the perspective of usability, users can delete noise and incorrect entries so that a system can provide more useful recommendations. While unlearning is very important, it has not been well-considered in existing recommender systems. Although there are some researches have studied the problem of machine unlearning in the domains of image and text data, existing methods can not been directly applied to recommendation as they are unable to consider the collaborative information.
In this paper, we propose RecEraser, a general and efficient machine unlearning framework tailored to recommendation task. The main idea of RecEraser is to partition the training set into multiple shards and train a constituent model for each shard. Specifically, to keep the collaborative information of the data, we first design three novel data partition algorithms to divide training data into balanced groups based on their similarity. Then, considering that different shard models do not uniformly contribute to the final prediction, we further propose an adaptive aggregation method to improve the global model utility. Experimental results on three public benchmarks show that RecEraser can not only achieve efficient unlearning, but also outperform the state-of-the-art unlearning methods in terms of model utility. The source code can be found at https://github.com/chenchongthu/Recommendation-Unlearning
Forget by Uncertainty: Orthogonal Entropy Unlearning for Quantized Neural Networks
Hubei Key Laboratory of Transportation Internet of Things, School of Computer Science and Artificial Intelligence, Wuhan University of Technology, China(交通物联网湖北重点实验室,计算机科学与人工智能学院,武汉理工大学,中国);College of Computing and Data Science, Nanyang Technological University, Singapore(计算与数据科学学院,南洋理工大学,新加坡)
Class-wise Federated Unlearning: Harnessing Active Forgetting with Teacher-Student Memory Generation
School of Communication Engineering, Hangzhou Dianzi University(杭州电子科技大学通信工程学院);College of Computer Science & Technology, Zhejiang University(浙江大学计算机科学与技术学院);School of Cyberspace, Hangzhou Dianzi University(杭州电子科技大学网络空间学院)
HKUST(香港科技大学);University of Cambridge(剑桥大学);Central South University(中南大学);Shanghai Jiaotong University(上海交通大学);SenseTime Research(商汤科技研究院);Tsinghua University(清华大学)
FaLW: A Forgetting-aware Loss Reweighting for Long-tailed Unlearning
University of Science and Technology of China(USTC)(中国科学技术大学);Suzhou Institute for Advanced Research, USTC(中国科学技术大学苏州研究院);City University of Hong Kong(香港城市大学);Tongji University(同济大学)
Bias Redistribution in Visual Machine Unlearning: Does Forgetting One Group Harm Another?
NewraLab;Beihang University(北京航空航天大学);GoerTek Alpha Lab(歌尔Alpha实验室);Skyline University Nigeria(尼日利亚天际线大学);UESTC(电子科技大学);Imperial College London(帝国理工学院)
Decoupling the Class Label and the Target Concept in Machine Unlearning
Hong Kong Baptist University(香港浸会大学);RIKEN Center for Advanced Intelligence Project(理化学研究所先进智能中心);Shanghai Jiao Tong University(上海交通大学);Shanghai AI Laboratory(上海人工智能实验室);The University of Tokyo(东京大学)
Is Gradient Ascent Really Necessary? Memorize to Forget for Machine Unlearning
Sydney AI Centre, The University of Sydney(悉尼人工智能中心,悉尼大学);Hong Kong Baptist University(香港 Baptist 大学);RIKEN AIP(日本理化学研究所AIP);University of Technology Sydney(悉尼技术大学)
Electrical Engineering and Computer Science, University of California, Merced, CA 95343, USA(电气工程与计算机科学系,加州大学默塞德分校);Department of Applied Mathematics, University of California, Merced, CA 95343, USA(应用数学系,加州大学默塞德分校);Department of Innovation and Research, North Carolina State University, Raleigh, NC, USA(创新与研究系,北卡罗来纳州立大学);Automation (MESA) Lab, Department of Mechanical Engineering, School of Engineering, University of California, Merced, CA 95343, USA(自动化(MESA)实验室,机械工程系,工程学院,加州大学默塞德分校)
Forget-It-All: Multi-Concept Machine Unlearning via Concept-Aware Neuron Masking
The University of Arizona(亚利桑那大学);The University of Tulsa(塔尔萨大学);Clemson University(克莱姆森大学);Western Digital Corporation(西部数据公司);University of Georgia(佐治亚大学)
Are We Truly Forgetting? A Critical Re-examination of Machine Unlearning Evaluation Protocols
Department of Artificial Intelligence, Korea University, South Korea(韩国大学人工智能系);Computer Science Dept. at Courant Institute of Mathemtical Sciences, New York University, United States(纽约大学Courant数学科学研究所计算机科学系)
Forget-MI: Machine Unlearning for Forgetting Multimodal Information in Healthcare Settings
Department of Machine Learning, Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, UAE Department of Computer Vision, Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, UAE Department of Computer Science, Michigan State University, United States 0.2cm
CYBERCAT (Center for Cybersecurity Research of Catalonia)(加泰罗尼亚网络安全研究中心);ComSCIAM-Center for Computational Science and Applied Mathematics(计算科学与应用数学中心);Department of Computer Engineering and Mathematics, Universitat Rovira i Virgili(罗维拉-维尔吉利大学计算机工程与数学系)