Classical machine learning algorithms often assume that the data are drawn i.i.d. from a stationary probability distribution. Recently, continual learning emerged as a rapidly growing area of machine learning where this assumption is relaxed, i.e. where the data distribution is non-stationary and changes over time. This paper represents the state of data distribution by a context variable $c$. A drift in $c$ leads to a data distribution drift.
A context drift may change the target distribution, the input distribution, or both. Moreover, distribution drifts might be abrupt or gradual. In continual learning, context drifts may interfere with the learning process and erase previously learned knowledge; thus, continual learning algorithms must include specialized mechanisms to deal with such drifts. In this paper, we aim to identify and categorize different types of context drifts and potential assumptions about them, to better characterize various continual-learning scenarios. Moreover, we propose to use the distribution drift framework to provide more precise definitions of several terms commonly used in the continual learning field.
Keep Rehearsing and Refining: Lifelong Learning Vehicle Routing under Continually Drifting Tasks
Center of Data Science and Artificial Intelligence & School of Engineering and Computer Science(数据科学与人工智能中心及工程与计算机科学学院);Victoria University of Wellington(怀特维尔大学);School of Data Science(数据科学学院)
本文提出了一种应对持续漂移任务的终身学习方法,通过Dual Replay with Experience Enhancement框架提升学习效率并缓解灾难性遗忘。
CoMemNet: A Continual Memory Network with Drift-Aware Sampling for Traffic Prediction
College of Computer Science, Shanghai Jiao Tong University(上海交通大学计算机科学学院);College of Computer Science and Technology, Zhejiang University of Technology(浙江工业大学计算机科学与技术学院);School of Automation, Nanjing University of Science and Technology(南京理工大学自动化学院)
Outlook Towards Deployable Continual Learning for Particle Accelerators
Thomas Jefferson National Accelerator Facility(托马斯杰斐逊国家加速器设施);University of Houston(休斯顿大学);SLAC National Laboratory(SLAC国家实验室);Oak Ridge National Laboratory(橡树岭国家实验室)
Overcoming Domain Drift in Online Continual Learning
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Suzhou University of Science and Technology(苏州科技大学);Youtu Lab, Tencent(腾讯优图实验室);College of Intelligence and Computing, Tianjin University(天津大学智能与计算学部)
PASs-MoE: Mitigating Misaligned Co-drift among Router and Experts via Pathway Activation Subspaces for Continual Learning
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);National University of Singapore(新加坡国立大学);Southeast University, Nanjing, China(南京东南大学);Wuhan AI Research, Wuhan, China(武汉人工智能研究院)
LoRA Subtraction for Drift-Resistant Space in Exemplar-Free Continual Learning
School of Artificial Intelligence, Sun Yat-sen University(中山大学人工智能学院);Key Laboratory of Intelligent Assessment Technology for Sustainable Tourism, Ministry of Culture and Tourism, Sun Yat-sen University(文化和旅游部可持续旅游智能评估技术重点实验室);Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education, China(教育部机器智能与先进计算重点实验室)
Drift and Dependence: Layer-wise Information-Theoretic Bounds for Replay-Based Continual Learning
School of Computer Science and Technology, Xi’an Jiaotong University(西安交通大学计算机科学与技术学院);Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系)
Energy-Structured Low-Rank Adaptation for Continual Learning
School of Computer Science and Engineering, Southeast University, Nanjing, China(东南大学计算机科学与工程学院,南京,中国);Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications (Southeast University), Ministry of Education, China(新一代人工智能技术及其交叉应用重点实验室(东南大学),教育部,中国);Huawei Technologies, Shenzhen, China(华为技术有限公司,深圳,中国)
ICICLE: Interpretable Class Incremental Continual Learning
Jagiellonian University(雅盖隆大学);Ardigen SA(阿迪根公司);Autonomous University of Barcelona(巴塞罗那自治大学);Computer Vision Center(计算机视觉中心);IDEAS NCBR(IDEAS国家计算智能研究中心)
Query Drift Compensation: Enabling Compatibility in Continual Learning of Retrieval Embedding Models
Computer Vision Center, Barcelona, Spain(巴塞罗那计算机视觉中心);Department of Computer Science, Universitat Autònoma de Barcelona, Spain(巴塞罗那自治大学计算机科学系);IDEAS Research Center, Warsaw, Poland(华沙IDEAS研究中心)
Faculty of Information Technology, University of Jyväskylä(约赫斯库利亚大学信息科技学院);National University of Singapore(新加坡国立大学);School of Computer Science and Technology, Dalian University of Technology(大连理工大学计算机科学与技术学院)
University of Bremen(不来梅大学);Jeonbuk National University(全北国立大学);TU Darmstadt(达姆施塔特工业大学);RIKEN Center for Advanced Intelligence Project(理化学研究所先进智能项目中心);Hessian Center for AI (hessian.AI)(黑森人工智能中心);University College London(伦敦大学学院)
MM-Prompt: Cross-Modal Prompt Tuning for Continual Visual Question Answering
Khoury College of Computer Sciences, Northeastern University(东北大学克劳尔计算机科学学院);New Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所模式识别新实验室)