Towards Benign Memory Forgetting for Selective Multimodal Large Language Model Unlearning
Hefei University of Technology(合肥工业大学);Institute of Artificial Intelligence, Hefei Comprehensive National Science Center(合肥综合性国家科学中心人工智能研究院);University of Amsterdam(阿姆斯特丹大学)
Zhen Zeng, Leijiang Gu, Zhangling Duan, Feng Li, Cees G. M. Snoek, Meng Wang, Zenglin Shi
Multimodal large language models (MLLMs) can inadvertently memorize privacy-sensitive information during training. While existing unlearning methods can remove such content, they often severely degrade the model's foundational capabilities, such as general image understanding. This critical shortfall motivates our investigation into benign memory forgetting, the precise removal of targeted, privacy-sensitive knowledge while rigorously preserving unrelated capabilities. To pioneer and evaluate progress toward this objective, we introduce S-MLLMUn Bench, the first benchmark designed to jointly and quantitatively assess an unlearning method's efficacy in knowledge erasure and the preservation of image understanding. Furthermore, we propose the Sculpted Memory Forgetting Adapter (SMFA), a new framework that enables benign memory forgetting. SMFA confines forgetting to designated memory regions, maintaining overall model performance. By initially fine-tuning the model to replace sensitive outputs with refusals, SMFA generates a memory forgetting adapter, followed by a retaining anchor-guided masking mechanism that safeguards unrelated knowledge. Extensive experiments on S-MLLMUn Bench demonstrate that existing methods fail to achieve benign forgetting, whereas our proposed SMFA serves as an effective baseline, successfully achieving targeted knowledge erasure without compromising the model's foundational visual capabilities. Code and data are available at https://github.com/zeng-zhen/S-MLLMUn.
Selective Forgetting: Advancing Machine Unlearning Techniques and Evaluation in Language Models
Harbin Institute of Technology(哈尔滨工业大学);Huawei Noah’s Ark Lab(华为诺亚方舟实验室);Unlimidata Ltd(Unlimidata有限公司);The Chinese University of Hong Kong(香港中文大学);University of Calabria(卡拉布里亚大学)
Quantization-Robust Unlearning through the Lens of Retain-Forget Loss Landscapes Interaction
University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);University of Pittsburgh(匹兹堡大学);University of Arizona(亚利桑那大学);University of Central Florida(中佛罗里达大学)
Forgetting-MarI: LLM Unlearning via Marginal Information Regularization
Department of Mathematics, University of California Davis, USA(加州大学戴维斯分校数学系);SLAC National Accelerator Laboratory, Stanford University, USA(斯坦福大学SLAC国家加速器实验室);Department of Computer Science, University of California Davis, USA(加州大学戴维斯分校计算机科学系)
OFFSIDE: Benchmarking Unlearning Misinformation in Multimodal Large Language Models
Harbin Institute of Technology(哈尔滨工业大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));BIAI, ZJUT & D5Data.ai(BIAI、浙江工业大学及D5Data.ai);National University of Singapore(新加坡国立大学)
Unlearning Isn't Deletion: Investigating Reversibility of Machine Unlearning in LLMs
The Hong Kong Polytechnic University(香港理工大学);Carnegie Mellon University(卡内基梅隆大学);University of California, Santa Cruz(加州大学圣克ruz分校);Huawei Technologies(华为技术有限公司);Research Centre for Privacy and Security Technologies in Future Smart Systems, PolyU(未来智能系统中的隐私与安全技术研究中心,PolyU)
UniErase: Towards Balanced and Precise Unlearning in Language Models
University of Science and Technology of China(中国科学技术大学);University of the Chinese Academy of Sciences(中国科学院大学);National University of Singapore(新加坡国立大学);Nanyang Technological University(南洋理工大学);A*STAR(科技研究局);Zhejiang University(浙江大学)
DP2Unlearning: An Efficient and Guaranteed Unlearning Framework for LLMs
Universitat Rovira i Virgili, Department of Computer Engineering(罗维拉-维格利大学计算机工程系);Mathematics, CYBERCAT-Center for Cybersecurity Research of Catalonia(数学,加泰罗尼亚网络安全研究中心)
ReLearn: Unlearning via Learning for Large Language Models
Zhejiang University(浙江大学);Xiamen University(厦门大学);Tsinghua University(清华大学);Harbin Institute of Technology(哈尔滨工业大学);National University of Singapore(新加坡国立大学);NUS-NCS Joint Lab(新加坡国立大学-新科系统联合实验室)
针对现有大模型遗忘方法破坏文本连贯性与评估指标不足的问题,提出数据增强微调流水线 ReLearn 及包含 KFR、KRR 和 LS 的综合评估框架,实现了高效目标遗忘并保持高质量生成。
Decoupling Knowledge Forgetting and Refusal Learning in MLLM Unlearning
College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics(南京航空航天大学计算机科学与技术学院);School of Intelligence Science and Technology, Nanjing University(南京大学智能科学与技术学院)
Releasing Malevolence from Benevolence: The Menace of Benign Data on Machine Unlearning
Zhejiang University(浙江大学);Hangzhou High-Tech Zone (Binjiang) Institute of Blockchain and Data Security(杭州高新区(滨江)区块链与数据安全研究院);CSIRO’s Data61(澳大利亚联邦科学与工业研究组织Data61);King Abdullah University of Science and Technology(阿卜杜拉国王科技大学);Shanghai Jiao Tong University(上海交通大学)
FaLW: A Forgetting-aware Loss Reweighting for Long-tailed Unlearning
University of Science and Technology of China(USTC)(中国科学技术大学);Suzhou Institute for Advanced Research, USTC(中国科学技术大学苏州研究院);City University of Hong Kong(香港城市大学);Tongji University(同济大学)
PECKER: A Precisely Efficient Critical Knowledge Erasure Recipe For Machine Unlearning in Diffusion Models
Cao Tu Li(Guangzhou) Technology Co., Ltd, China(广州曹图利科技有限公司,中国);South China University of Technology, China(华南理工大学,中国);Guangzhou Xinhua University, China(广州新华大学,中国);Hong Kong Baptist University, HongKong(香港 Baptist 大学,香港)