基于解耦目标性学习与类别识别的持续分割
Continual Segmentation with Disentangled Objectness Learning and Class Recognition
AI总结:
本文提出 CoMasTRe,将持续分割解耦为抗遗忘的目标性学习与持续分类两阶段,并设计多标签类别蒸馏策略,在 PASCAL VOC 和 ADE20K 上优于逐像素和基于查询的方法。
摘要:
大多数持续分割方法将该问题视为逐像素分类任务。然而,这种范式非常具有挑战性,我们发现具有内置目标性的基于查询的分割器相比逐像素分割器具有固有优势,因为目标性具有很强的迁移能力和抗遗忘能力。基于这些发现,我们提出 CoMasTRe,将持续分割解耦为两个阶段:抗遗忘的持续目标性学习和已被充分研究的持续分类。CoMasTRe 使用两阶段分割器,在第一阶段学习类别无关的掩码提议,并将识别留给第二阶段。在持续学习过程中,采用一种简单但有效的蒸馏来增强目标性。为了进一步缓解旧类别的遗忘,我们设计了一种适合分割的多标签类别蒸馏策略。我们在 PASCAL VOC 和 ADE20K 上评估了 CoMasTRe 的有效性。大量实验表明,我们的方法在两个数据集上均优于逐像素方法和基于查询的方法。代码将在 https://github.com/jordangong/CoMasTRe 提供。
英文摘要:
Most continual segmentation methods tackle the problem as a per-pixel classification task. However, such a paradigm is very challenging, and we find query-based segmenters with built-in objectness have inherent advantages compared with per-pixel ones, as objectness has strong transfer ability and forgetting resistance. Based on these findings, we propose CoMasTRe by disentangling continual segmentation into two stages: forgetting-resistant continual objectness learning and well-researched continual classification. CoMasTRe uses a two-stage segmenter learning class-agnostic mask proposals at the first stage and leaving recognition to the second stage. During continual learning, a simple but effective distillation is adopted to strengthen objectness. To further mitigate the forgetting of old classes, we design a multi-label class distillation strategy suited for segmentation. We assess the effectiveness of CoMasTRe on PASCAL VOC and ADE20K. Extensive experiments show that our method outperforms per-pixel and query-based methods on both datasets. Code will be available at https://github.com/jordangong/CoMasTRe.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。