Improving LLM Unlearning Robustness via Random Perturbations
Japan Advanced Institute of Science and Technology(日本科学技术先进研究院);VNU University of Engineering and Technology(越南工程与技术大学);Monash University(莫纳什大学);RIKEN(日本研究机构)
Here, we show that current LLM unlearning methods inherently reduce models' robustness, causing them to misbehave even when a single non-adversarial forget-token is present in the retain-query. Toward understanding underlying causes, we propose a novel theoretical framework that reframes the unlearning process as a backdoor attack and defense problem: we formulate how the forgetting process inadvertently learns to align forget-tokens (backdoor triggers) with the target-representations (target labels). As a result, forget-tokens act as backdoor triggers that, when activated in retain-queries, cause disruptions in unlearned models' behaviors, similar to successful backdoor attacks. The sense that, LLM unlearning methods themselves poison the model, make it more vulnerable to forget-tokens, and hide rather than erase target knowledge, describes their true mechanism. To mitigate the vulnerability caused by the forgetting process, we reinterpret the retaining process as a backdoor defense and propose Random Noise Augmentation (RNA), a lightweight, model and method-agnostic approach with theoretical guarantees for improving the robustness of unlearned models. Extensive experiments demonstrate that RNA significantly improves the robustness of unlearned models while preserving forget and retain performances. This backdoor attack-defense framework offers insights into the mechanism of unlearning that can shed light on future research directions for improving unlearning robustness.
Towards Robust Knowledge Unlearning: An Adversarial Framework for Assessing and Improving Unlearning Robustness in Large Language Models
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
Machine Unlearning Meets Adversarial Robustness via Constrained Interventions on LLMs
Department of Computer Science, Université Paris-Dauphine(巴黎-索邦大学计算机科学系);Institute of Mathematics, EPFL(苏黎世联邦理工学院数学研究所);Computational Engineering Lab, Empa(Empa计算工程实验室)
School of Advanced Interdisciplinary Sciences, UCAS(UCAS交叉学科研究院);Academy of Mathematics and Systems Science, CAS(中国科学院数学与系统科学研究院);Institute of Computing Technology, CAS(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学)
Dual-Space Smoothness for Robust and Balanced LLM Unlearning
School of Data Science, The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳)数据科学学院);Department of Computer Science and Engineering, University of Notre Dame(圣母大学计算机科学与工程系)
OFFSIDE: Benchmarking Unlearning Misinformation in Multimodal Large Language Models
Harbin Institute of Technology(哈尔滨工业大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));BIAI, ZJUT & D5Data.ai(BIAI、浙江工业大学及D5Data.ai);National University of Singapore(新加坡国立大学)
Machine Unlearning of Pre-trained Large Language Models
University of Virginia(弗吉尼亚大学);Georgia Institute of Technology(佐治亚理工学院);The Hong Kong Polytechnic University(香港理工大学);University of Melbourne(墨尔本大学);Carnegie Mellon University(卡内基梅隆大学)
LMU Munich(慕尼黑大学);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);Technical University of Munich(慕尼黑技术大学);Siemens AG(西门子股份公司);University of Oxford(牛津大学)
School of Computer Science, Beijing University of Posts and Telecommunications(北京邮电大学计算机科学学院);Shandong University(山东大学);New Laboratory of Pattern Recognition (NLPR), State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS), Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
针对 LLM 遗忘受知识表达形式制约的问题,本文提出 ORT 基准量化形式依赖偏差,并给出免训练的 ROCR 方法,通过秩一概念重定向实现更有效且自然的遗忘。
Consistency-Aware Editing for Entity-level Unlearning in Language Models
Shanxi University, China(山西大学);Cardiff University, UK(卡地夫大学);Singapore University of Technology and Design, Singapore(新加坡科技设计大学);ILCC, School of Informatics, University of Edinburgh, Edinburgh, UK(爱丁堡大学信息学院ILCC)
Unlearning Sensitive Information in Multimodal LLMs: Benchmark and Attack-Defense Evaluation
Department of Computer Science(计算机科学系);University of North Carolina at Chapel Hill(北卡罗来纳大学 Chapel Hill 分校);School of Artificial Intelligence and Data Science(人工智能与数据科学学院);University of Science and Technology of China(中国科学技术大学)