Human Motion Prediction via Continual Prior Compensation
School of Computer Science, Sun Yat-sen University(中山大学计算机学院);Guangdong Province Key Laboratory of Information Security Technology(广东省信息安全技术重点实验室);Key Laboratory of Machine Intelligence and Advanced Computing (Sun Yat-sen University), Ministry of Education(教育部机器智能与先进计算重点实验室(中山大学))
Human Motion Prediction (HMP) aims to predict future human poses at different moments according to observed past motion sequences. Previous approaches mainly treated the prediction of different temporal moments as a single prediction task and learned the predictions of varied moments simultaneously, which would encounter a main limitation: the learning of short-term predictions (referring to ``near-future'' prediction) could be hindered by the predictions of long-term (referring to ``far-future'' prediction) motions. In this paper, we develop a novel temporal continual learning framework called Continual Prior Compensation (CPC) to progressively train HMP models, in which we divide the prediction task of motions corresponding to varied temporal moments into several subtasks and train the model in a multi-stage manner. To mitigate the prior information forgetting in the progressive training, we further introduce a learnable random variable Prior Compensation Factor (PCF) to explicitly measure the prior knowledge loss. We theoretically show that the PCF can be efficiently learned together with the model parameters by minimizing a reasonable upper bound of the objective function. The proposed CPC is further enhanced to estimate the prior information loss for each subtask and a new framework called Continual Prior Compensation++ (CPC++) with Fine-Grained Prior Compensation Factor (FGPCF) is finally developed. Our CPC and CPC++ frameworks are quite flexible and can be easily integrated with different HMP backbone models and adapted to various datasets and applications. Extensive experiments on three HMP benchmark datasets using multiple SOTA HMP backbones (PGBIG, siMLPe, MotionMixer, and LTD) demonstrate the effectiveness and flexibility of our frameworks.
Continual Adapter Tuning with Semantic Shift Compensation for Class-Incremental Learning
HUST AI & Visual Learning Lab (HAIV Lab)(华中科技大学人工智能与视觉学习实验室);Huazhong University of Science and Technology (HUST)(华中科技大学);Department of Computer Science(计算机科学系);Boston University(波士顿大学);ByteDance, Inc.(字节跳动公司)
ICICLE: Interpretable Class Incremental Continual Learning
Jagiellonian University(雅盖隆大学);Ardigen SA(阿迪根公司);Autonomous University of Barcelona(巴塞罗那自治大学);Computer Vision Center(计算机视觉中心);IDEAS NCBR(IDEAS国家计算智能研究中心)
Prior-free Balanced Replay: Uncertainty-guided Reservoir Sampling for Long-Tailed Continual Learning
Shenzhen Research Institute of Big Data (SRIBD)(深圳大数据研究院);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));The Hong Kong University of Science and Technology(香港科技大学);The Hong Kong Polytechnic University(香港理工大学)
Continual Alignment for SAM: Rethinking Foundation Models for Medical Image Segmentation in Continual Learning
Xi’an Jiaotong University(西安交通大学);School of Information and Communications Engineering, Xi’an Jiaotong University(信息与通信工程学院);School of Mathematics and Statistics, Xi’an Jiaotong University(数学与统计学学院)
Prior-Free Continual Learning with Unlabeled Data in the Wild
Shandong Artificial Intelligence Institute, Qilu University of Technology (Shandong Academy of Sciences)(齐鲁工业大学(山东省科学院)山东人工智能研究院);Zhejiang University(浙江大学);National University of Singapore(新加坡国立大学)
Hierarchical-Task-Aware Multi-modal Mixture of Incremental LoRA Experts for Embodied Continual Learning
Ping An Technology (Shenzhen) Co., Ltd.(平安科技(深圳)有限公司);Tsinghua Shenzhen International Graduate School(清华大学深圳国际研究生院);Tsinghua University(清华大学);Huazhong University of Science and Technology(华中科技大学)
Self-paced Weight Consolidation for Continual Learning
Shenyang Institute of Automation, Chinese Academy of Sciences(中国科学院沈阳自动化研究所);Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences(中国科学院机器人与智能制造创新研究院);University of Chinese Academy of Sciences(中国科学院大学)
Semi-parametric Memory Consolidation: Towards Brain-like Deep Continual Learning
Centre for Artificial Intelligence and Robotics(人工智能与机器人中心);Hong Kong Institute of Science and Innovation(香港科学与创新研究院);Chinese Academy of Sciences(中国科学院);Department of Computer Science(计算机科学系);City University of Hong Kong(香港城市大学);The Department of Neurosurgery(神经外科部门);Peking University First Hospital(北京大学第一医院);State Key Laboratory of Multimodal Artificial Intelligence Systems(多模态人工智能系统国家重点实验室);Institute of Automation(自动化研究所);Hong Kong SAR, China(香港特别行政区,中国)
C^2Prompt: Class-aware Client Knowledge Interaction for Federated Continual Learning
Wangxuan Institute of Computer Technology Peking University(北京大学王轩计算机技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Inner Mongolia University of Technology(内蒙古科技大学)
Octopus: History-Free Gradient Orthogonalization for Continual Learning in Multimodal Large Language Models
MoE Key Lab of Artificial Intelligence, AI Institute, Shanghai Jiao Tong University(人工智能大模型关键实验室,人工智能研究院,上海交通大学);vivo Mobile Communication Co., Ltd.(vivo移动通信有限公司)
China-UAE Belt and Road Joint Laboratory on Intelligent Unmanned Systems, School of Aerospace Engineering, Beijing Institute of Technology(中国-阿联酋“一带一路”智能无人系统联合实验室,北京理工大学宇航学院)
BasicAVSR: Arbitrary-Scale Video Super-Resolution via Image Priors and Enhanced Motion Compensation
Faculty of Computing, Harbin Institute of Technology(哈尔滨工业大学计算机学院);School of Computer Science and Engineering, University of Electronic Science and Technology of China(电子科技大学计算机科学与工程学院);Tianjin Key Laboratory of Machine Learning, College of Intelligence and Computing, Tianjin University(天津机器学习重点实验室,天津大学智能计算学院)
Continual Segmentation under Joint Nonstationarity
Bharti School of Telecommunications Technology \& Management, Indian Institute of Technology, Delhi, India;Yardi School of Artificial Intelligence, Indian Institute of Technology, Delhi, India;Department of Computer Science;Engineering, Indian Institute of Technology (Indian School of Mines), Dhanbad, India