Machine unlearning aims to remove the influence of specific training data from pre-trained models without retraining from scratch, and is increasingly important for large language models (LLMs) due to safety, privacy, and legal concerns. Although prior work primarily evaluates unlearning in static, single-turn settings, forgetting robustness under realistic interactive use remains underexplored. In this paper, we study whether unlearning remains stable in interactive environments by examining two common interaction patterns: self-correction and dialogue-conditioned querying. We find that knowledge appearing forgotten in static evaluation can often be recovered through interaction. Although stronger unlearning improves apparent robustness, it often results in behavioral rigidity rather than genuine knowledge erasure. Our findings suggest that static evaluation may overestimate real-world effectiveness and highlight the need for ensuring stable forgetting under interactive settings.
A Comprehensive Survey of Machine Unlearning Techniques for Large Language Models
Mohamed bin Zayed University of Artificial Intelligence (MBZUAI)(莫扎德大学人工智能学院);Fraunhofer Institute for Open Communication Systems (FOKUS)(弗劳恩霍夫开放通信系统研究所);Technical University of Munich(慕尼黑技术大学);Technical University of Darmstadt(达姆施塔特技术大学);University of Toronto(多伦多大学)
OFFSIDE: Benchmarking Unlearning Misinformation in Multimodal Large Language Models
Harbin Institute of Technology(哈尔滨工业大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));BIAI, ZJUT & D5Data.ai(BIAI、浙江工业大学及D5Data.ai);National University of Singapore(新加坡国立大学)
Consistency-Aware Editing for Entity-level Unlearning in Language Models
Shanxi University, China(山西大学);Cardiff University, UK(卡地夫大学);Singapore University of Technology and Design, Singapore(新加坡科技设计大学);ILCC, School of Informatics, University of Edinburgh, Edinburgh, UK(爱丁堡大学信息学院ILCC)
Machine Unlearning of Pre-trained Large Language Models
University of Virginia(弗吉尼亚大学);Georgia Institute of Technology(佐治亚理工学院);The Hong Kong Polytechnic University(香港理工大学);University of Melbourne(墨尔本大学);Carnegie Mellon University(卡内基梅隆大学)
LMU Munich(慕尼黑大学);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);Technical University of Munich(慕尼黑技术大学);Siemens AG(西门子股份公司);University of Oxford(牛津大学)
Knowledge Beyond Language: Bridging the Gap in Multilingual Machine Unlearning Evaluation
GSCST, Seoul National University(首尔国立大学GSCST);AIIS, Seoul National University(首尔国立大学AIIS);Department of Artificial Intelligence, Chung-Ang University(Chung-Ang大学人工智能系);Korean Surgical Researcher Foundation, Republic of Korea(韩国外科研究员基金会)
Model Collapse Is Not a Bug but a Feature in Machine Unlearning for LLMs
Dept. of Computer Science & Munich Data Science Institute, Technical University of Munich(计算机科学系及慕尼黑数据科学研究所,技术大学慕尼黑);Mila, Université de Montréal(蒙特利尔大学Mila)
ReLearn: Unlearning via Learning for Large Language Models
Zhejiang University(浙江大学);Xiamen University(厦门大学);Tsinghua University(清华大学);Harbin Institute of Technology(哈尔滨工业大学);National University of Singapore(新加坡国立大学);NUS-NCS Joint Lab(新加坡国立大学-新科系统联合实验室)
针对现有大模型遗忘方法破坏文本连贯性与评估指标不足的问题,提出数据增强微调流水线 ReLearn 及包含 KFR、KRR 和 LS 的综合评估框架,实现了高效目标遗忘并保持高质量生成。
Mitigating Sensitive Information Leakage in LLMs4Code through Machine Unlearning
College of Computer Science and Technology, National University of Defense Technology, Changsha, Hunan, 410073, China(计算机科学与技术学院,国防科技大学,长沙,湖南,410073,中国);Xichang Satellite Launch Center, Xichang, Sichuan, 615000, China(西昌卫星发射中心,西昌,四川,615000,中国);Academy of Military Sciences, Beijing, 100091, China(军事科学院,北京,100091,中国)
CLUE: Conflict-guided Localization for LLM Unlearning Framework
Hang Chen School of Computer Science and Technology Xi’an Jiaotong University(陈hang 硕士生 计算机科学与技术学院 西安交通大学);Jiaying Zhu School of Computer Science and Engineering The Chinese University of Hong Kong(朱纪莹 计算机科学与工程学院 香港中文大学);Xinyu Yang School of Computer Science and Technology Xi’an Jiaotong University(杨新宇 硕士生 计算机科学与技术学院 西安交通大学);Wenya Wang School of Computer Science and Engineering Nanyang Technological University(王文亚 计算机科学与工程学院 新加坡国立大学)
Hierarchical Dual-Strategy Unlearning for Biomedical and Healthcare Intelligence Using Imperfect and Privacy-Sensitive Medical Data
Department of Neurosurgery, Qilu Hospital of Shandong University and Institute of Brain and Brain-Inspired Science(齐鲁医院山东大学神经外科和脑科学与脑启发科学研究院);Department of Neurosurgery, The Affiliated Hospital of Qingdao University(青岛大学附属医院神经外科);Department of Neurosurgery, Peking Union Medical College Hospital(北京地坛医院神经外科);School of Software and Microelectronics, Peking University(北京大学软件与微电子学院);College of Artificial Intelligence, Dalian Maritime University(大连海事大学人工智能学院);University of Colorado Boulder(科罗拉多大学波尔德分校);Zhengzhou University(郑州大学);The University of Hong Kong(香港大学);Georgia Institute of Technology(佐治亚理工学院)
Beyond Ideal Instruction: A Comprehensive Framework for Evaluating LLMs in Realistic Interactions
Department of Data Science, City University of Hong Kong(香港城市大学数据科学系);Hong Kong Institute of AI for Science, City University of Hong Kong(香港城市大学人工智能科学研究院);Li Auto Inc.(Li汽车公司);Beijing University of Posts and Telecommunications(北京邮电大学);Independent Researcher(独立研究员)
A Comprehensive Analysis of the Effectiveness of Large Language Models as Automatic Dialogue Evaluators
National University of Singapore(新加坡国立大学);University of Electronic Science and Technology of China(电子科技大学);The Chinese University of Hong Kong (Shenzhen)(香港中文大学(深圳))