Heterogeneous Forgetting Compensation for Class-Incremental Learning
State Key Laboratory of Robotics, Shenyang Institute of AutomationChinese Academy of Sciences（中国科学院沈阳自动化研究所机器人学国家重点实验室）；Institutes for Robotics and Intelligent ManufacturingChinese Academy of Sciences（中国科学院机器人与智能制造研究所）；University of Chinese Academy of Sciences（中国科学院大学）；South China University of Technology（华南理工大学）
Class-incremental learning (CIL) has achieved remarkable successes in learning new classes consecutively while overcoming catastrophic forgetting on old categories. However, most existing CIL methods unreasonably assume that all old categories have the same forgetting pace, and neglect negative influence of forgetting heterogeneity among different old classes on forgetting compensation. To surmount the above challenges, we develop a novel Heterogeneous Forgetting Compensation (HFC) model, which can resolve heterogeneous forgetting of easy-to-forget and hard-to-forget old categories from both representation and gradient aspects. Specifically, we design a task-semantic aggregation block to alleviate heterogeneous forgetting from representation aspect. It aggregates local category information within each task to learn task-shared global representations. Moreover, we develop two novel plug-and-play losses: a gradient-balanced forgetting compensation loss and a gradient-balanced relation distillation loss to alleviate forgetting from gradient aspect. They consider gradient-balanced compensation to rectify forgetting heterogeneity of old categories and heterogeneous relation consistency. Experiments on several representative datasets illustrate effectiveness of our HFC model. The code is available at https://github.com/JiahuaDong/HFC.
Causes of Catastrophic Forgetting in Class-Incremental Semantic Segmentation
Porsche Engineering Group GmbH（保时捷工程集团有限公司）；Fraunhofer Institute of Optronics, Systems Technologies and Image Exploitation IOSB（弗劳恩霍夫光电、系统技术与图像利用研究所IOSB）；Karlsruhe Institute of Technology（卡尔斯鲁厄理工学院）
类增量学习的语义分割（Class-incremental learning for semantic segmentation，CiSS）是目前一个高度研究的领域，其目的是通过顺序地学习新的语义类来更新语义分割模型。CiSS中的一个主要挑战是克服灾难性遗忘的影响，它描述了在一组新的类上训练模型后，先前学习的类的准确性突然下降。尽管在减轻灾难性遗忘方面取得了最新进展，但人们对CiSS中遗忘的根本原因还没有很好的理解。因此，在一组实验和代表性的分析，我们表明，背景类的语义转移和对新类的偏见是遗忘的主要原因在CiSS。此外，我们发现这两个原因主要表现在网络的更深分类层，而模型的早期层不受影响。最后，我们展示了如何有效地减轻这两个原因，利用背景中包含的信息，与知识蒸馏和无偏交叉熵损失的帮助。
Gradient-Semantic Compensation for Incremental Semantic Segmentation
Shenyang Institute of Automation, Chinese Academy of Sciences（中国科学院沈阳自动化研究所）；Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences（中国科学院机器人与智能制造创新研究院）；University of Chinese Academy of Sciences（中国科学院大学）；Nanyang Technological University（南洋理工大学）
Defying Imbalanced Forgetting in Class Incremental Learning
State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所多模态人工智能系统全国重点实验室）；School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院）；Centre for Artificial Intelligence and Robotics, HK Institute of Science & Innovation, Chinese Academy of Sciences（中国科学院香港创新研究院人工智能与机器人中心）；School of Intelligence Science and Technology, University of Science and Technology, Beijing（北京科技大学智能科学与技术学院）
I3DOL: Incremental 3D Object Learning without Catastrophic Forgetting
Shenyang Institute of Automation, Chinese Academy of Sciences（中国科学院沈阳自动化研究所）；Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences（中国科学院机器人与智能制造研究院）；University of Chinese Academy of Sciences（中国科学院大学）；Northeastern University（东北大学）
Non-Forgetting Knowledge Allocation with Bi-level Competition for Class-Incremental Learning
South China University of Technology（华南理工大学）；Hong Kong Polytechnic University（香港理工大学）；Agency for Science, Technology and Research（科技研究局）；Microsoft（微软）；Guilin University of Electronic Technology（桂林电子科技大学）；Sun Yat-sen University（中山大学）
ProtoFlow: Mitigating Forgetting in Class-Incremental Remote Sensing Segmentation via Low-Curvature Prototype Flow
Faculty of Health Data Science, Juntendo University（静冈大学健康数据科学学院）；The Institute of Collaborative Innovation, University of Macau（澳门大学协同创新研究所）；Department of Information and Computing Sciences, Faculty of Science, Utrecht University（乌得勒支大学科学学院信息与计算科学系）；Department of Computer and Information Science, University of Pennsylvania（宾夕法尼亚大学计算机与信息科学系）；School of Computer Science, University of Chinese Academy of Sciences（中国科学院大学计算机科学学院）；Department of Computer & Information Science & Engineering, University of Florida（佛罗里达大学计算机与信息科学与工程系）；Department of Computer Science, Juniata College（朱尼塔学院计算机科学系）；National Engineering Research Center for Beijing Biochip Technology（北京生物芯片工程技术研究中心）；CapitalBio Corporation（资本生物公司）；Faculty of Engineering & Information Technology, University of Technology Sydney（悉尼科技大学工程与信息技术学院）；University Research and Innovation Center (EKIK), Obuda University（布达佩斯大学研究与创新中心（EKIK））；Faculty of Science and Technology, University of Macau（澳门大学科学与技术学院）；Department of Mathematics, University of Southern California（南加州大学数学系）
Not Just Object, But State: Compositional Incremental Learning without Forgetting
International School of Information Science & Engineering, Dalian University of Technology（大连理工大学信息科学与工程国际学院）；MAIS&CRIPAC, Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）
Enhancing Generative Class Incremental Learning Performance with Model Forgetting Approach
Graduate School of Information Science and Technology, Hokkaido University（北海道大学信息科学与技术研究院）；Faculty of Information Science and Technology, Hokkaido University（北海道大学信息科学与技术学院）
Learning to Imagine: Diversify Memory for Incremental Learning using Unlabeled Data
Sun Yat-sen University（中山大学）；Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education（教育部机器智能与先进计算重点实验室）；Peng Cheng Laboratory（鹏城实验室）
DCA: Dividing and Conquering Amnesia in Incremental Object Detection
Institute of Information Engineering, Chinese Academy of Sciences（中国科学院信息工程研究所）；College of Computer Science, Nankai University（南开大学计算机学院）；School of Cyber Security, University of Chinese Academy of Sciences（中国科学院大学网络空间安全学院）；Harbin Institute of Technology（哈尔滨工业大学）；Tsinghua University（清华大学）
InOR-Net: Incremental 3D Object Recognition Network for Point Cloud Representation
Shenyang Institute of Automation, Chinese Academy of Sciences（中国科学院沈阳自动化研究所）；University of Chinese Academy of Sciences（中国科学院大学）；Northwestern University（西北大学）；Sony AI（索尼人工智能研究院）；Nanjing University of Science and Technology（南京理工大学）；ETH Zurich（苏黎世联邦理工学院）
