Test-time adaptation (TTA) seeks to tackle potential distribution shifts between training and testing data by adapting a given model w.r.t. any testing sample. This task is particularly important for deep models when the test environment changes frequently. Although some recent attempts have been made to handle this task, we still face two practical challenges: 1) existing methods have to perform backward computation for each test sample, resulting in unbearable prediction cost to many applications; 2) while existing TTA solutions can significantly improve the test performance on out-of-distribution data, they often suffer from severe performance degradation on in-distribution data after TTA (known as catastrophic forgetting). In this paper, we point out that not all the test samples contribute equally to model adaptation, and high-entropy ones may lead to noisy gradients that could disrupt the model. Motivated by this, we propose an active sample selection criterion to identify reliable and non-redundant samples, on which the model is updated to minimize the entropy loss for test-time adaptation. Furthermore, to alleviate the forgetting issue, we introduce a Fisher regularizer to constrain important model parameters from drastic changes, where the Fisher importance is estimated from test samples with generated pseudo labels. Extensive experiments on CIFAR-10-C, ImageNet-C, and ImageNet-R verify the effectiveness of our proposed method.
Uncertainty-Calibrated Test-Time Model Adaptation without Forgetting
School of Software Engineering, South China University of Technology(华南理工大学软件工程学院);Key Laboratory of Big Data and Intelligent Robot, Ministry of Education(教育部大数据与智能机器人重点实验室);Pazhou Laboratory(琶洲实验室);Nanyang Technological University(南洋理工大学);ByteDance, China(字节跳动(中国));Tencent AI Lab(腾讯AI实验室);School of Computing, National University of Singapore(新加坡国立大学计算机学院)
Replay on Demand: An Emergent Curriculum for Balancing Adaptation and Forgetting in Continued Pretraining
University of Tübingen(图宾根大学);Tübingen AI Center(图宾根人工智能中心);Helmholtz Munich(亥姆霍兹慕尼黑中心);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);Thomson Reuters Foundational Research(汤森路透基础研究);Imperial College London(伦敦帝国理工学院);Technical University of Munich(慕尼黑工业大学)
Evolving Machine Learning in Non-Stationary Environments: A Unified Survey of Drift, Forgetting, and Adaptation
School of Architecture, Technology and Engineering, University of Brighton(建筑、技术与工程学院,布里奇顿大学);Department of Mathematics and Computer Science, Eindhoven University of Technology(数学与计算机科学系,埃因霍温理工大学)
Mitigating Catastrophic Forgetting in Language Transfer via Model Merging
INSAIT, Sofia University “St. Kliment Ohridski”(INSAIT、索菲亚大学“圣·克利门特·奥赫里德斯基”);ETH Zurich(苏黎世联邦理工学院);University of Chicago(芝加哥大学);Together AI;Google DeepMind(谷歌DeepMind)
Sequential Learning and Catastrophic Forgetting in Differentiable Resistor Networks
Mathematics Applications Consortium for Science and Industry (MACSI), Department of Mathematics and Statistics, University of Limerick, Limerick, Ireland(数学应用科学与工业联盟(MACSI)、数学与统计学系、利默里克大学、利默里克、爱尔兰)
Dynamic Context-oriented Decomposition for Task-aware Low-rank Adaptation with Less Forgetting and Faster Convergence
King Abdullah University of Science and Technology, Saudi Arabia(卡布尔大学);University of California, Merced, USA(加州大学梅尔德分校);University of Oxford, U.K.(牛津大学)
Onboarding Without Forgetting: Hypernetwork Personalization with Data-Free Replay for Personalized Federated Learning
VinUni-Illinois Smart Health Center(VinUni-Illinois智能健康中心);College of Engineering & Computer Science(工程与计算机科学学院);University of Notre Dame(诺特丹大学);Technische Universität Berlin(柏林技术大学)
CEL: A Continual Learning Model for Disease Outbreak Prediction by Leveraging Domain Adaptation via Elastic Weight Consolidation
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学);University of Macau(澳门大学)
CONTRAST: Continual Multi-source Adaptation to Dynamic Distributions
Brookhaven National Laboratory(布鲁克海文国家实验室);University of California, Riverside(加州大学河滨分校);AWS AI Labs(亚马逊云科技人工智能实验室);University of Michigan, Ann Arbor(密歇根大学安娜堡分校)
MEMTS: Internalizing Domain Knowledge via Parameterized Memory for Retrieval-Free Domain Adaptation of Time Series Foundation Models
East China Normal University(东华师范大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Peking University(北京大学);University of Chinese Academy of Sciences(中国科学院大学)
Replay Buffer with Local Forgetting for Adapting to Local Environment Changes in Deep Model-Based Reinforcement Learning
Mila - Quebec AI Institute(米拉-魁北克人工智能研究所);Université de Montréal(蒙特利尔大学);Microsoft Research(微软研究院);École Polytechnique de Montréal(蒙特利尔高等理工学院);Canada CIFAR AI Chair(加拿大CIFAR人工智能讲席)
Analytic Continual Test-Time Adaptation for Multi-Modality Corruption
South China University of Technology(华南理工大学);Institute of Science Tokyo(东京科学研究所);Southern University of Science and Technology(南方科技大学);Nanyang Technological University(南洋理工大学)
Online Fast Adaptation and Knowledge Accumulation: a New Approach to Continual Learning
ElementAI(ElementAI公司);Mila - Quebec AI Institute(米拉-魁北克人工智能研究所);Université de Montréal(蒙特利尔大学);Facebook AI Research(脸书人工智能研究院);McGill University(麦吉尔大学);HEC Montréal(蒙特利尔高等商学院)
Mechanistic Analysis of Catastrophic Forgetting in Large Language Models During Continual Fine-tuning
Division of Statistics and Machine Learning (STIMA), Department of Computer and Information Science (IDA), Linköping University(统计与机器学习系(STIMA)、计算机与信息科学系(IDA)、利厄普堡大学)
School of Electrical and Electronic Engineering, Yonsei University(延世大学电气电子工程学院);Department of Radiology and Center for Clinical Imaging Data Science, College of Medicine, Yonsei University(延世大学医学院放射科和临床影像数据科学中心);Artificial Intelligence and Robotics Institute, Korea Institute of Science and Technology(韩国科学技术院人工智能与机器人研究所)
SloMo-Fast: Slow-Momentum and Fast-Adaptive Teachers for Source-Free Continual Test-Time Adaptation
Center for Computational & Data Sciences, Independent University, Bangladesh(计算与数据科学中心,独立大学,孟加拉国);University of Central Florida, USA(佛罗里达中央大学,美国);University of Virginia, USA(弗吉尼亚大学,美国);Amazon GenAI, USA(亚马逊生成人工智能,美国)