Continual learning (CL) has emerged as a pivotal paradigm to enable large language models (LLMs) to dynamically adapt to evolving knowledge and sequential tasks while mitigating catastrophic forgetting, a critical limitation of the static pre-training paradigm inherent to modern LLMs. This paper presents a comprehensive overview of CL methodologies tailored for LLMs, structured around three core training stages: continual pre-training, continual fine-tuning, and continual alignment. Beyond the canonical taxonomy of rehearsal-, regularization-, and architecture-based methods, we further subdivide each category by its distinct forgetting mitigation mechanisms and conduct a rigorous comparative analysis of the adaptability and critical improvements of traditional CL methods for LLMs. In doing so, we explicitly highlight core distinctions between LLM CL and traditional machine learning, particularly with respect to scale, parameter efficiency, and emergent capabilities. Our analysis covers essential evaluation metrics, including forgetting rates and knowledge transfer efficiency, along with emerging benchmarks for assessing CL performance. While current methods show promising results, fundamental challenges persist in achieving seamless knowledge integration, and we identify key open problems and future directions for the field.
ContiGuard: A Framework for Continual Toxicity Detection Against Evolving Evasive Perturbations
School of Computer Science(计算机科学学院);Wuhan University(武汉大学);Zhongguancun Academy(中关村学院);Key Laboratory of Computing Power Network and Information Security, Ministry of Education, Shandong Computer Science Center (National Supercomputer Center in Jinan)(计算能力网络与信息安全重点实验室,教育部,山东计算机科学中心(济南国家超级计算机中心));Qilu University of Technology (Shandong Academy of Sciences)(齐鲁工业大学(山东科学院));Shandong Provincial Key Laboratory of Computing Power Internet and Service Computing(山东省计算能力互联网与服务计算重点实验室);Shandong Fundamental Research Center for Computer Science(山东省计算机科学基础研究中心)
From a Prompt to Repertoires: Evolving Functional REpertoires Enable LLM Continual Learning
The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Shanghai AI Laboratory(上海人工智能实验室);University of Science and Technology of China(中国科学技术大学);New Jersey Institute of Technology(新泽西理工学院)
Rethinking Continual Experience Internalization for Self-Evolving LLM Agents
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学人工智能学院 Gallagher 学院);School of Software, Beihang University(北航软件学院);Meituan(美团)
SwitchCIT: Switching for Continual Instruction Tuning
Coordinated Science Laboratory(协调科学实验室);Department of Electrical and Computer Engineering(电气与计算机工程系);Department of Mathematics(数学系);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
SafeCoEvo: Co-Evolving Safety Harnesses and Guards for LLM Agents at Test-Time
East China Normal University(华东师范大学);Shanghai Innovation Institute(上海创新研究院);Xiamen University(厦门大学);Harbin Institute of Technology(哈尔滨工业大学);University College London(伦敦大学学院);Huawei Noah’s Ark Lab, UK(华为诺亚方舟实验室(英国));MemoraX AI
The Future of Continual Learning in the Era of Foundation Models: Three Key Directions
Department of Computer Science, Università di Pisa(帕尔马大学计算机科学系);Institute of Information Science and Technologies, National Research Council(信息科学与技术研究所,国家研究理事会)
Learn it or Leave it: Module Composition and Pruning for Continual Learning
Bosch Center for Artificial Intelligence(博世人工智能中心);LMU Munich(慕尼黑大学);Hochschule der Medien(慕尼黑应用科技大学);Karlsruhe University of Applied Sciences(卡尔斯鲁厄应用科技大学)
EmbodiedCLBench: Evaluating Continual Learning for Self-Evolving Embodied Agents
School of Intelligence Science and Technology, Peking University(北京大学智能科学与技术学院);State Key Laboratory of General Artificial Intelligence, BIGAI(北京通用人工智能研究院通用人工智能国家重点实验室);University of Hong Kong(香港大学)
College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);ZJU-Ant Group Joint Research Center for Knowledge Graphs, Zhejiang University(浙江大学-蚂蚁集团知识图谱联合研究中心);School of Software Technology, Zhejiang University(浙江大学软件学院);Monash University(莫纳什大学);Hangzhou Dianzi University(杭州电子科技大学);Zhejiang Lab(之江实验室)