Artificial neural networks, celebrated for their human-like cognitive learning abilities, often encounter the well-known catastrophic forgetting (CF) problem, where the neural networks lose the proficiency in previously acquired knowledge. Despite numerous efforts to mitigate CF, it remains the significant challenge particularly in complex changing environments. This challenge is even more pronounced in cross-domain adaptation following the continual learning (CL) setting, which is a more challenging and realistic scenario that is under-explored. To this end, this article proposes a cross-domain CL approach making possible to deploy a single model in such environments without additional labelling costs. Our approach, namely continual learning approach for many processes (CLAMP), integrates a class-aware adversarial domain adaptation strategy to align a source domain and a target domain. An assessor-guided learning process is put forward to navigate the learning process of a base model assigning a set of weights to every sample controlling the influence of every sample and the interactions of each loss function in such a way to balance the stability and plasticity dilemma thus preventing the CF problem. The first assessor focuses on the negative transfer problem rejecting irrelevant samples of the source domain while the second assessor prevents noisy pseudo labels of the target domain. Both assessors are trained in the meta-learning approach using random transformation techniques and similar samples of the source domain. Theoretical analysis and extensive numerical validations demonstrate that CLAMP significantly outperforms established baseline algorithms across all experiments by at least $10\%$ margin.
Prototype-Guided Non-Exemplar Continual Learning for Cross-subject EEG Decoding
Dept. of Artificial Intelligence Korea University Seoul, Republic of Korea(人工智能系 韩国大学首尔共和国);Cognitive Engineering Korea University Seoul, Republic of Korea(认知工程 韩国大学首尔共和国)
MM-Prompt: Cross-Modal Prompt Tuning for Continual Visual Question Answering
Khoury College of Computer Sciences, Northeastern University(东北大学克劳尔计算机科学学院);New Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所模式识别新实验室)
Dynamic Cross-Modal Prompt Generation for Multimodal Continual Instruction Tuning
School of Artificial Intelligence, Nanjing University(南京大学人工智能学院);State Key Laboratory for Novel Software Technology, Nanjing University(南京大学新型软件技术国家重点实验室)
Nanyang Technological University(南洋理工大学);University of South Australia(南澳大学);Singapore Institute of Manufacturing Technology (SIMTech)(新加坡制造技术研究院);Agency for Science, Technology and Research (A*STAR)(新加坡科技研究局)
Exploring Fine-tuning Techniques for Pre-trained Cross-lingual Models via Continual Learning
Center for Artificial Intelligence Research (CAiRE)(人工智能研究中心(CAiRE));Department of Electronic and Computer Engineering(电子与计算机工程系);The Hong Kong University of Science and Technology(香港科技大学)
The Chinese University of Hong Kong(香港中文大学);National University of Singapore(新加坡国立大学);Yale University(耶鲁大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))
CM2-Net: Continual Cross-Modal Mapping Network for Driver Action Recognition
School of Electrical and Electronic Engineering, Nanyang Technological University(南洋理工大学电气与电子工程学院);Continental-NTU Corporate Lab, Nanyang Technological University(大陆集团-南洋理工大学联合企业实验室);College of Computer Science and Technology, Harbin Engineering University(哈尔滨工程大学计算机科学与技术学院)
On Generalizing Beyond Domains in Cross-Domain Continual Learning
The Australian National University(澳大利亚国立大学);NEC Labs America(美国NEC实验室);Monash University(莫纳什大学);Data61(Data61研究院);Phiar Technologies(Phiar科技公司);University of California, San Diego(加州大学圣地亚哥分校)
Cross-Domain Continual Learning for Edge Intelligence in Wireless ISAC Networks
College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算与数据科学学院);School of Cyber Science and Engineering, Xi’an Jiaotong University(西安交通大学网络空间安全学院)
Continual-NExT: A Unified Comprehension And Generation Continual Learning Framework
East China Normal University(华东师范大学);Shanghai Innovation Institute(上海创新研究院);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Xiamen University(厦门大学)
A Continual Learning Approach for Cross-Domain White Blood Cell Classification
Helmholtz Munich – German Research Center for Environmental Health(亥姆霍兹慕尼黑-德国环境健康研究中心);Technical University of Munich(慕尼黑工业大学);Ludwig-Maximilian University Munich(路德维希-马克西米利安慕尼黑大学);University Hospital, Ludwig-Maximilians University Munich(慕尼黑大学附属医院);Roche Innovation Center Munich (RICM)(罗氏慕尼黑创新中心);Johns Hopkins University(约翰斯·霍普金斯大学)
M2RU: Memristive Minion Recurrent Unit for On-Chip Continual Learning at the Edge
NUAI Lab, Department of Electrical and Computer Engineering, University of Texas at San Antonio and Department of Electrical Engineering, University of Baghdad(NUAI实验室,电子与计算机工程系,德克萨斯大学圣安东尼奥分校和电子工程系,巴格达大学)
Towards General Purpose Medical AI: Continual Learning Medical Foundation Model
Beijing University of Posts and Telecommunications(北京邮电大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);West China Hospital, Sichuan University(四川大学华西医院);Shanghai Jiao Tong University(上海交通大学);Sichuan University Pittsburgh Institute(四川大学匹兹堡学院)
Bisecle: Binding and Separation in Continual Learning for Video Language Understanding
School of Computer Science University of New South Wales(计算机科学学院新南威尔士大学);School of Computer Science and Engineering University of New South Wales(计算机科学与工程学院新南威尔士大学);DEVCOM Army Research Laboratory(陆军研究实验室)
Continual Learning with Elastic Regularization and Synthetic Replay for Federated MLLM Fine-Tuning
The University of British Columbia(英属哥伦比亚大学);Fudan University(复旦大学);Royal College of Science, Imperial College London(伦敦帝国理工学院皇家科学学院);Dyson School of Design Engineering(戴森设计工程学院);Suzhou Institute of Biomedical Engineering and Technology (SIBET), Chinese Academy of Sciences(中国科学院苏州生物医学工程技术研究所);East China Normal University(华东师范大学)
Decision-Focused Continual Learning for Seaport Power-Logistics Scheduling: Generalization across Varying Tasks
College of Smart Energy, Shanghai Jiao Tong University(上海交通大学智能能源学院);School of Electrical and Electronic Engineering, Nanyang Technological University(南洋理工大学电子与电气工程学院);School of Electrical Engineering, Shanghai Jiao Tong University(上海交通大学电气工程学院);Dyson School of Design Engineering, Imperial College London(伦敦帝国理工学院戴森设计工程学院)