Continual test-time adaptation (CTTA) has recently emerged to adapt a pre-trained source model to continuously evolving target distributions, which accommodates the dynamic nature of real-world environments. To mitigate the risk of catastrophic forgetting in CTTA, existing methods typically incorporate explicit regularization terms to constrain the variation of model parameters. However, they cannot fundamentally resolve catastrophic forgetting because they rely on a single shared model to adapt across all target domains, which inevitably leads to severe inter-domain interference. In this paper, we introduce learnable domain-specific prompts that guide the model to adapt to corresponding target domains, thereby partially disentangling the parameter space of different domains. In the absence of domain identity for target samples, we propose a novel dynamic Prompt AllocatIon aNd Tuning (PAINT) method, which utilizes a query mechanism to dynamically determine whether the current samples come from a known domain or an unexplored one. For known domains, the corresponding domain-specific prompt is directly selected, while for previously unseen domains, a new prompt is allocated. Prompt tuning is subsequently performed using mutual information maximization along with structural regularization. Extensive experiments on three benchmark datasets demonstrate the effectiveness of our PAINT method for CTTA. We have released our code at https://github.com/Cadezzyr/PAINT.
Subspace Optimization for Backpropagation-Free Continual Test-Time Adaptation
Poznan University of Technology(波兹南理工大学);IDEAS NCBR;NASK - National Research Institute(NASK国家研究所);Gdańsk University of Technology(格但斯克理工大学);Graz University of Technology(格拉茨理工大学)
Conformal Uncertainty Indicator for Continual Test-Time Adaptation
New Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所新模式识别实验室);China Nuclear Power Engineering Co., LTD(中国核电工程有限公司);College of Intelligence and Computing, Tianjin University(天津大学智能与计算学部);School of Computer Science & Engineering, LinYi University(临沂大学计算机科学与工程学院);School of Electric & Information Engineering, Suzhou University of Science and Technology(苏州科技大学电子与信息工程学院)
C-LoRA: Continual Low-Rank Adaptation for Pre-trained Visual Models
Institute of Intelligent Information Processing, Shanxi University(山西大学智能信息处理研究所);Alliance Manchester Business School, The University of Manchester(曼彻斯特大学联盟曼彻斯特商学院)
Online Fast Adaptation and Knowledge Accumulation: a New Approach to Continual Learning
ElementAI(ElementAI公司);Mila - Quebec AI Institute(米拉-魁北克人工智能研究所);Université de Montréal(蒙特利尔大学);Facebook AI Research(脸书人工智能研究院);McGill University(麦吉尔大学);HEC Montréal(蒙特利尔高等商学院)
Dynamic Allocation Hypernetwork with Adaptive Model Recalibration for Federated Continual Learning
National University of Singapore(新加坡国立大学);Southeast University(东南大学);Institute of High Performance Computing, A*STAR(新加坡科技研究局高性能计算研究所);Case Western Reserve University(凯斯西储大学)
The Golden Subspace: Where Efficiency Meets Generalization in Continual Test-Time Adaptation
School of Artificial Intelligence, Nanjing University(南京大学人工智能学院);National Key Laboratory for Novel Software Technology, Nanjing University(南京大学新型软件技术国家重点实验室);Hong Kong University of Science and Technology(香港科技大学);Frontier Robotics(前沿机器人)
Unifying Detection and Adaptation in Task-Free Continual Learning
School of Control Science and Engineering, Shandong University(山东大学控制科学与工程学院);The Hong Kong University of Science and Technology(香港科技大学);Shandong University(山东大学);Qilu Hospital of Shandong University(山东大学齐鲁医院)
FedCTTA: A Collaborative Approach to Continual Test-Time Adaptation in Federated Learning
1 Center for Computational \& Data Sciences, Independent University, Bangladesh;2 Curtin University;Center for Computational \& Data Sciences Independent University, Bangladesh;School of Electrical Engineering, Computing \& Mathematical Sciences (EECMS) Curtin University
Analytic Continual Test-Time Adaptation for Multi-Modality Corruption
South China University of Technology(华南理工大学);Institute of Science Tokyo(东京科学研究所);Southern University of Science and Technology(南方科技大学);Nanyang Technological University(南洋理工大学)
EDAPT: Towards Calibration-Free BCIs with Continual Online Adaptation
Excellence Cluster Machine Learning, University of Tübingen(卓越集群机器学习中心,图宾根大学);Tübingen AI Center, University of Tübingen(图宾根人工智能中心,图宾根大学);Department of Neurology and Stroke, University of Tübingen(神经学与中风部门,图宾根大学);Hertie Institute for Clinical Brain Research, University of Tübingen(赫尔特研究所,图宾根大学);Department of Empirical Inference, Max Planck Institute for Intelligent Systems(经验推理部门,智能系统马克斯·普朗克研究所);Hertie Institute for AI in Brain Health, Tübingen(赫尔特人工智能与脑健康研究所,图宾根)