A central capability of intelligent systems is the ability to continuously build upon previous experiences to speed up and enhance learning of new tasks. Two distinct research paradigms have studied this question. Meta-learning views this problem as learning a prior over model parameters that is amenable for fast adaptation on a new task, but typically assumes the set of tasks are available together as a batch. In contrast, online (regret based) learning considers a sequential setting in which problems are revealed one after the other, but conventionally train only a single model without any task-specific adaptation. This work introduces an online meta-learning setting, which merges ideas from both the aforementioned paradigms to better capture the spirit and practice of continual lifelong learning. We propose the follow the meta leader algorithm which extends the MAML algorithm to this setting. Theoretically, this work provides an $\mathcal{O}(\log T)$ regret guarantee with only one additional higher order smoothness assumption in comparison to the standard online setting. Our experimental evaluation on three different large-scale tasks suggest that the proposed algorithm significantly outperforms alternatives based on traditional online learning approaches.
DIB-OD: Preserving the Invariant Core for Robust Heterogeneous Graph Adaptation via Decoupled Information Bottleneck and Online Distillation
School of Information Technology and Engineering, Tianjin University of Technology and Education（天津职业技术师范大学信息技术工程学院）；School of Computer Science and Technology, Tiangong University（天工大学计算机科学与技术学院）；Department of Computer Science at University of Exeter（埃克塞特大学计算机科学系）
Brain-Inspired Online Adaptation for Remote Sensing with Spiking Neural Network
Brain-Inspired Application Technology Center (BATC)（脑启发应用技术中心）；School of Electronic Information and Electrical Engineering（电子信息与电气工程学院）；Shanghai Jiao Tong University（上海交通大学）；ATR Key Lab（ATR重点实验室）；School of Electronic Science and Engineering（电子科学与工程学院）；National University of Defense Technology（国防科学技术大学）
Online Fast Adaptation and Knowledge Accumulation: a New Approach to Continual Learning
ElementAI（ElementAI公司）；Mila - Quebec AI Institute（米拉-魁北克人工智能研究所）；Université de Montréal（蒙特利尔大学）；Facebook AI Research（脸书人工智能研究院）；McGill University（麦吉尔大学）；HEC Montréal（蒙特利尔高等商学院）
Threshold Modulation for Online Test-Time Adaptation of Spiking Neural Networks
Department of CSE, Southern University of Science and Technology（南方科技大学计算机科学与工程系）；College of Mathematics and Statistics, Chongqing University（重庆大学数学与统计学院）；ACS Laboratory, Huawei Technologies Co., Ltd.（华为技术有限公司ACS实验室）
Meta-Learning Online Dynamics Model Adaptation in Off-Road Autonomous Driving
Jet Propulsion Laboratory, California Institute of Technology（喷气推进实验室、加州理工学院）；University of Texas at Austin（德克萨斯大学奥斯汀分校）；Georgia Institute of Technology（佐治亚理工学院）
Driver Drowsiness Estimation from EEG Signals Using Online Weighted Adaptation Regularization for Regression (OwARR)
DataNova；U.S. Army Research Laboratory（美国陆军研究实验室）；University of Texas at San Antonio（德克萨斯大学圣安东尼奥分校）；DCS Corp（DCS公司）；University of Technology, Sydney（悉尼科技大学）；National Chiao-Tung University（国立交通大学）
GIPSO: Geometrically Informed Propagation for Online Adaptation in 3D LiDAR Segmentation
University of Trento（特伦托大学）；Télécom-Paris, Intitute Polytechnique de Paris（巴黎理工学院电信巴黎）；Sapienza University of Rome（罗马第一大学）；NVIDIA AI Technology Center（英伟达人工智能技术中心）；Fondazione Bruno Kessler（布鲁诺·凯斯勒基金会）
Online Test-Time Adaptation for Generalizable Dynamic Graph Anomaly Detection
The Hong Kong Polytechnic University（香港理工大学）；Institute of Information Processing and Automation, Zhejiang University of Technology（浙江工业大学信息处理与自动化研究所）；University of Illinois at Chicago (UIC)（伊利诺伊大学芝加哥分校）
STAG: Structural Test-time Alignment of Gradients for Online Adaptation
Seoul National University, Seoul, Republic of Korea；Division of Artificial Intelligence \& Software, Ewha Womans University, Seoul, Republic of Korea；Microsoft, Redmond, WA, USA；Georgia Institute of Technology, Atlanta, GA, USA
The Golden Subspace: Where Efficiency Meets Generalization in Continual Test-Time Adaptation
School of Artificial Intelligence, Nanjing University（南京大学人工智能学院）；National Key Laboratory for Novel Software Technology, Nanjing University（南京大学新型软件技术国家重点实验室）；Hong Kong University of Science and Technology（香港科技大学）；Frontier Robotics（前沿机器人）
Multi-Feature Riemannian Hypergraph for Online Test-Time Adaptation of Motor Imagery Brain-Computer Interface
Peking University（北京大学）；Chinese Institute for Brain Research（中国脑科学研究院）；NeuCyber Neurotech（纽赛博神经科技公司）；Beijing Medical University（北京医科大学）；Chinese Academy of Medical Sciences & Peking Union Medical College（中国医学科学院北京协和医学院）
EDAPT: Towards Calibration-Free BCIs with Continual Online Adaptation
Excellence Cluster Machine Learning, University of Tübingen（卓越集群机器学习中心，图宾根大学）；Tübingen AI Center, University of Tübingen（图宾根人工智能中心，图宾根大学）；Department of Neurology and Stroke, University of Tübingen（神经学与中风部门，图宾根大学）；Hertie Institute for Clinical Brain Research, University of Tübingen（赫尔特研究所，图宾根大学）；Department of Empirical Inference, Max Planck Institute for Intelligent Systems（经验推理部门，智能系统马克斯·普朗克研究所）；Hertie Institute for AI in Brain Health, Tübingen（赫尔特人工智能与脑健康研究所，图宾根）
Online Continual Adaptation with Active Self-Training
Tsinghua-Berkeley Shenzhen Institute（清华-伯克利深圳学院）；Tsinghua Shenzhen International Graduate School（清华大学深圳国际研究生院）；Tsinghua University（清华大学）；University of Illinois at Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）；University of California, Berkeley（加州大学伯克利分校）
OCEAN: Online Task Inference for Compositional Tasks with Context Adaptation
Stanford University（斯坦福大学）；The University of Texas at Austin（德克萨斯大学奥斯汀分校）；Nvidia（英伟达）；California Institute of Technology（加州理工学院）；University of Toronto（多伦多大学）；Vector Institute（向量研究所）
