Fast and Continual Knowledge Graph Embedding via Incremental LoRA
School of Computer Science and Engineering, Southeast University（东南大学计算机科学与工程学院）；Institute of Computing Technology, Chinese Academy of Sciences（中国科学院计算技术研究所）；College of Software Engineering, Southeast University（东南大学软件学院）
Jiajun Liu, Wenjun Ke, Peng Wang, Jiahao Wang, Jinhua Gao, Ziyu Shang, Guozheng Li, Zijie Xu, Ke Ji, Yining Li
Continual Knowledge Graph Embedding (CKGE) aims to efficiently learn new knowledge and simultaneously preserve old knowledge. Dominant approaches primarily focus on alleviating catastrophic forgetting of old knowledge but neglect efficient learning for the emergence of new knowledge. However, in real-world scenarios, knowledge graphs (KGs) are continuously growing, which brings a significant challenge to fine-tuning KGE models efficiently. To address this issue, we propose a fast CKGE framework (\model), incorporating an incremental low-rank adapter (\mec) mechanism to efficiently acquire new knowledge while preserving old knowledge. Specifically, to mitigate catastrophic forgetting, \model\ isolates and allocates new knowledge to specific layers based on the fine-grained influence between old and new KGs. Subsequently, to accelerate fine-tuning, \model\ devises an efficient \mec\ mechanism, which embeds the specific layers into incremental low-rank adapters with fewer training parameters. Moreover, \mec\ introduces adaptive rank allocation, which makes the LoRA aware of the importance of entities and adjusts its rank scale adaptively. We conduct experiments on four public datasets and two new datasets with a larger initial scale. Experimental results demonstrate that \model\ can reduce training time by 34\%-49\% while still achieving competitive link prediction performance against state-of-the-art models on four public datasets (average MRR score of 21.0\% vs. 21.1\%).Meanwhile, on two newly constructed datasets, \model\ saves 51\%-68\% training time and improves link prediction performance by 1.5\%.
Dual-LoRA and Quality-Enhanced Pseudo Replay for Multimodal Continual Food Learning
College of Computer Science and Artificial Intelligence, Fudan University, China（复旦大学计算机科学与人工智能学院）；Singapore Management University, Singapore（新加坡国立管理学院）
CoRe-MoE: Compact Reusable MoE for Continual Multimodal Instruction Tuning
Institute of Information Engineering, Chinese Academy of Sciences（中国科学院信息工程研究所）；School of Cyber Security, University of Chinese Academy of Sciences（中国科学院大学网络空间安全学院）
Orthogonal Subspace Projection for Continual Machine Unlearning via SVD-Based LoRA
Institute for Digital Technologies, Loughborough University, UK（伦敦大学数字技术研究所，英国）；School of Artificial Intelligent Medicine, Guilin Medical University（桂林医学院人工智能医学院）
Contrastive Regularization over LoRA for Multimodal Biomedical Image Incremental Learning
School of Computer Science and Engineering, Central South University（计算机科学与工程学院，中南大学）；School of Automation, Central South University（自动化学院，中南大学）；School of Computer Science and Technology, Beijing Jiaotong University（计算机科学与技术学院，北京交通大学）
ICICLE: Interpretable Class Incremental Continual Learning
Jagiellonian University（雅盖隆大学）；Ardigen SA（阿迪根公司）；Autonomous University of Barcelona（巴塞罗那自治大学）；Computer Vision Center（计算机视觉中心）；IDEAS NCBR（IDEAS国家计算智能研究中心）
Energy-Structured Low-Rank Adaptation for Continual Learning
School of Computer Science and Engineering, Southeast University, Nanjing, China（东南大学计算机科学与工程学院，南京，中国）；Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications (Southeast University), Ministry of Education, China（新一代人工智能技术及其交叉应用重点实验室（东南大学），教育部，中国）；Huawei Technologies, Shenzhen, China（华为技术有限公司，深圳，中国）
LoRA Subtraction for Drift-Resistant Space in Exemplar-Free Continual Learning
School of Artificial Intelligence, Sun Yat-sen University（中山大学人工智能学院）；Key Laboratory of Intelligent Assessment Technology for Sustainable Tourism, Ministry of Culture and Tourism, Sun Yat-sen University（文化和旅游部可持续旅游智能评估技术重点实验室）；Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education, China（教育部机器智能与先进计算重点实验室）
Merge then Realign: Simple and Effective Modality-Incremental Continual Learning for Multimodal LLMs
Harbin Institute of Technology, Shenzhen（哈尔滨工业大学（深圳））；Guangdong Provincial Key Laboratory of Novel Security Intelligence Technologies（广东省新型安全智能技术重点实验室）
Efficient Continual Learning in Neural Machine Translation: A Low-Rank Adaptation Approach
Pattern Recognition and Human Language Technology, Universitat Politècnica de València（模式识别与人类语言技术，瓦伦西亚理工大学）；Valencian Graduate School and Research Network of Artificial Intelligence, Universitat Politècnica de València（瓦伦西亚人工智能研究生学院与研究网络，瓦伦西亚理工大学）
PASs-MoE: Mitigating Misaligned Co-drift among Router and Experts via Pathway Activation Subspaces for Continual Learning
Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）；University of Chinese Academy of Sciences（中国科学院大学）；National University of Singapore（新加坡国立大学）；Southeast University, Nanjing, China（南京东南大学）；Wuhan AI Research, Wuhan, China（武汉人工智能研究院）
Continual Adapter Tuning with Semantic Shift Compensation for Class-Incremental Learning
HUST AI & Visual Learning Lab (HAIV Lab)（华中科技大学人工智能与视觉学习实验室）；Huazhong University of Science and Technology (HUST)（华中科技大学）；Department of Computer Science（计算机科学系）；Boston University（波士顿大学）；ByteDance, Inc.（字节跳动公司）
Enhancing Generative Class Incremental Learning Performance with Model Forgetting Approach
Graduate School of Information Science and Technology, Hokkaido University（北海道大学信息科学与技术研究院）；Faculty of Information Science and Technology, Hokkaido University（北海道大学信息科学与技术学院）
GEM-Style Constraints for PEFT with Dual Gradient Projection in LoRA
Department of Computer Science University of North Carolina Greensboro（计算机科学系北卡罗来纳州立大学）；Department of Computer Science North Carolina State University（计算机科学系北卡罗来纳州立大学）
Practical Continual Forgetting for Pre-trained Vision Models
State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences（多模态人工智能系统国家重点实验室，自动化研究所，中国科学院）；University of Chinese Academy of Sciences（中国科学院大学）；Centre for Artificial Intelligence and Robotics, Hong Kong Institute of Science & Innovation, Chinese Academy of Sciences（人工智能与机器人中心，香港科学创新研究院，中国科学院）；SenseTime Research（商汤科技研究院）
