University of Málaga(马拉加大学);University of Córdoba(科尔多瓦大学);Univ. Grenoble Alpes(格勒诺布尔阿尔卑斯大学);Inria(法国国家信息与自动化研究所);CNRS(法国国家科学研究中心);Grenoble INP(格勒诺布尔国立高等物理、数学与信息学院)
Francisco M. Castro, Manuel J. Marín-Jiménez, Nicolás Guil, Cordelia Schmid, Karteek Alahari
Although deep learning approaches have stood out in recent years due to their state-of-the-art results, they continue to suffer from catastrophic forgetting, a dramatic decrease in overall performance when training with new classes added incrementally. This is due to current neural network architectures requiring the entire dataset, consisting of all the samples from the old as well as the new classes, to update the model -a requirement that becomes easily unsustainable as the number of classes grows. We address this issue with our approach to learn deep neural networks incrementally, using new data and only a small exemplar set corresponding to samples from the old classes. This is based on a loss composed of a distillation measure to retain the knowledge acquired from the old classes, and a cross-entropy loss to learn the new classes. Our incremental training is achieved while keeping the entire framework end-to-end, i.e., learning the data representation and the classifier jointly, unlike recent methods with no such guarantees. We evaluate our method extensively on the CIFAR-100 and ImageNet (ILSVRC 2012) image classification datasets, and show state-of-the-art performance.
Advancing Cross-domain Discriminability in Continual Learning of Vision-Language Models
Institute of Science Tokyo(东京科学研究院);University of California Berkeley(加州大学伯克利分校);Nanyang Technological University(南洋理工大学);South China University of Technology(华南理工大学);Greater Bay Area Institute for Innovation, Hunan University(湖南大学粤港澳大湾区创新研究院)
Few-shot Class-incremental Learning for Cross-domain Disease Classification
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学);Pengcheng Laboratory(鹏城实验室)
Cs2K: Class-specific and Class-shared Knowledge Guidance for Incremental Semantic Segmentation
Shenyang Institute of Automation, Chinese Academy of Sciences(中国科学院沈阳自动化研究所);Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences(中国科学院机器人与智能制造研究院);University of Chinese Academy of Sciences(中国科学院大学);College of Automation Science and Engineering, South China University of Technology(华南理工大学自动化科学与工程学院);Peking University(北京大学)
Self-Sustaining Representation Expansion for Non-Exemplar Class-Incremental Learning
University of Science and Technology of China(中国科学技术大学);Institute of Artificial Intelligence, Hefei Comprehensive National Science Center(合肥综合性国家科学中心人工智能研究院);University of Rochester(罗切斯特大学)
Towards Non-Exemplar Semi-Supervised Class-Incremental Learning
University of Chinese Academy of Sciences(中国科学院大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Centre for Artificial Intelligence and Robotics, Hong Kong Institute of Science and Innovation, Chinese Academy of Sciences(中国科学院香港创新研究院人工智能与机器人中心)
Organizing Background to Explore Latent Classes for Incremental Few-shot Semantic Segmentation
University of Chinese Academy of Sciences(中国科学院大学);Nanjing University of Posts and Telecommunications(南京邮电大学);Beijing University of Posts and Telecommunications(北京邮电大学)
Multi-View Correlation Distillation for Incremental Object Detection
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院)
Exemplar-Free Class Incremental Learning via Incremental Representation
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);School of Mathematics and Statistics, Beijing Technology and Business University(北京工商大学数学与统计学院)
Contrastive Regularization over LoRA for Multimodal Biomedical Image Incremental Learning
School of Computer Science and Engineering, Central South University(计算机科学与工程学院,中南大学);School of Automation, Central South University(自动化学院,中南大学);School of Computer Science and Technology, Beijing Jiaotong University(计算机科学与技术学院,北京交通大学)
Revisiting Distillation and Incremental Classifier Learning
National University of Sciences and Technology(国家科技大学);School of Electrical Engineering and Computer Science(电子工程与计算机科学学院);National Center of Artificial Intelligence(国家人工智能中心)