Pre-trained vision-language models (VLMs), such as CLIP, have demonstrated remarkable zero-shot generalization, enabling deployment in a wide range of real-world tasks without additional task-specific training. However, in real deployment scenarios with evolving environments or emerging classes, these models inevitably face distributional shifts and novel tasks. In such contexts, static zero-shot capabilities are insufficient, and there is a growing need for continual learning methods that allow models to adapt over time while avoiding catastrophic forgetting. We introduce NuSA-CL (Null Space Adaptation for Continual Learning), a lightweight memory-free continual learning framework designed to address this challenge. NuSA-CL employs low-rank adaptation and constrains task-specific weight updates to lie within an approximate null space of the model's current parameters. This strategy minimizes interference with previously acquired knowledge, effectively preserving the zero-shot capabilities of the original model. Unlike methods relying on replay buffers or costly distillation, NuSA-CL imposes minimal computational and memory overhead, making it practical for deployment in resource-constrained, real-world continual learning environments. Experiments show that our framework not only effectively preserves zero-shot transfer capabilities but also achieves highly competitive performance on continual learning benchmarks. These results position NuSA-CL as a practical and scalable solution for continually evolving zero-shot VLMs in real-world applications.
CASCADE: Case-Based Continual Adaptation for Large Language Models During Deployment
School of Artificial Intelligence, Jilin University(吉林大学人工智能学院);Engineering Research Center of Knowledge-Driven Human-Machine Intelligence, Jilin University(吉林大学知识驱动人机智能工程研究中心);International Center of Future Science, Jilin University(吉林大学未来科学国际中心);Department of Informatics, King’s College London(伦敦国王学院信息学院);The Alan Turing Institute(艾伦·图灵研究所);AI Centre, Department of Computer Science, UCL(UCL计算机科学系人工智能中心)
Continual Knowledge Adaptation for Reinforcement Learning
South China University of Technology(南方科技大学);Pazhou Laboratory(Pazhou实验室);Chongqing University of Posts and Telecommunications(重庆邮电大学);Key Laboratory of Big Data and Intelligent Robot, Ministry of Education(大数据与智能机器人重点实验室,教育部)
Online Fast Adaptation and Knowledge Accumulation: a New Approach to Continual Learning
ElementAI(ElementAI公司);Mila - Quebec AI Institute(米拉-魁北克人工智能研究所);Université de Montréal(蒙特利尔大学);Facebook AI Research(脸书人工智能研究院);McGill University(麦吉尔大学);HEC Montréal(蒙特利尔高等商学院)
Forensic-Aware Continual Adaptation for Image Forgery Localization
National University of Singapore(新加坡国立大学);Nanyang Technological University(南洋理工大学);Jiangxi University of Finance and Economics(江西财经大学);Sichuan University(四川大学)
Efficient Continual Learning in Neural Machine Translation: A Low-Rank Adaptation Approach
Pattern Recognition and Human Language Technology, Universitat Politècnica de València(模式识别与人类语言技术,瓦伦西亚理工大学);Valencian Graduate School and Research Network of Artificial Intelligence, Universitat Politècnica de València(瓦伦西亚人工智能研究生学院与研究网络,瓦伦西亚理工大学)
Analytic Continual Test-Time Adaptation for Multi-Modality Corruption
South China University of Technology(华南理工大学);Institute of Science Tokyo(东京科学研究所);Southern University of Science and Technology(南方科技大学);Nanyang Technological University(南洋理工大学)
Distribution-Aware Continual Test-Time Adaptation for Semantic Segmentation
National Key Laboratory for Multimedia Information Processing, School of CS, Peking University(北京大学计算机学院多媒体信息处理国家重点实验室);University of Washington(华盛顿大学);Baidu Inc.(百度公司)
Online Continual Adaptation with Active Self-Training
Tsinghua-Berkeley Shenzhen Institute(清华-伯克利深圳学院);Tsinghua Shenzhen International Graduate School(清华大学深圳国际研究生院);Tsinghua University(清华大学);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of California, Berkeley(加州大学伯克利分校)
Visual Prompt Tuning in Null Space for Continual Learning
School of Computer Science, Northwestern Polytechnical University(西北工业大学计算机学院);School of Telecommunications Engineering, Xidian University(西安电子科技大学通信工程学院)
针对持续学习中的灾难性遗忘,本文提出在 ViT 提示梯度的零空间方向进行正交投影更新,并给出理论条件与近似实现,在多个类别增量基准上优于现有方法。
Enhancing Plasticity for First Session Adaptation Continual Learning
LTCI, Télécom-Paris, Institut Polytechnique de Paris(Télécom-Paris 工程院);University of Bergamo(贝加莫大学);Inria at University Grenoble Alpes, LJK(格勒诺布尔阿尔卑斯大学)
CEL: A Continual Learning Model for Disease Outbreak Prediction by Leveraging Domain Adaptation via Elastic Weight Consolidation
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学);University of Macau(澳门大学)
Continual-Learning-as-a-Service (CLaaS): On-Demand Efficient Adaptation of Predictive Models
Peoples' Friendship University of Russia (RUDN University)(俄罗斯人民友谊大学(RUDN大学));Joint Institute for Nuclear Research(联合核研究所);Vrije Universiteit Amsterdam(阿姆斯特丹自由大学);University of Skövde(舍夫德大学);University of Pisa(比萨大学)
Continual Learning for Traversability Prediction with Uncertainty-Aware Adaptation
Ulsan National Institute of Science and Technology(蔚山国立科学技术院);Munich Institute of Robotics and Machine Intelligence (MIRMI), Technical University of Munich (TUM)(慕尼黑机器人与机器智能研究所(MIRMI),慕尼黑工业大学(TUM))