arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2201.06974cs.CVcs.AIcs.MM
收藏

语义分割中的连续由粗到细领域自适应

Continual Coarse-to-Fine Domain Adaptation in Semantic Segmentation

University of Padova(帕多瓦大学)

Donald Shenaj, Francesco Barbato, Umberto Michieli, Pietro Zanuttigh

摘要:

深度神经网络通常针对特定任务和数据分布进行Single Shot训练,但在现实世界中,任务和应用领域都可能发生变化。这个问题在密集预测任务中变得更具挑战性,例如语义分割,而且大多数方法分别解决这两个问题。在本文中,我们介绍了新的任务,从粗到精学习的语义分割架构存在的域转移。我们认为后续的学习阶段在语义层面上逐步完善任务;即,在每个学习步骤处的语义标签的较精细集合是从先前步骤的较粗糙集合分层地导出的。我们提出了一种新的方法(CCDA)来解决这种情况。首先,我们采用最大平方损失来对齐源域和目标域,同时平衡分类良好的样本和较难的样本之间的梯度。其次,我们引入了一种新的粗到细的知识蒸馏约束,将网络能力从一组较粗的标签转移到一组较细的标签。最后,我们设计了一个由粗到细的权重初始化规则,将重要性从每个粗类传播到相应的细类。为了评估我们的方法,我们设计了两个基准测试,其中从GTA 5数据集中提取源知识,并将其转移到Cityscapes或IDD数据集,并展示它如何优于主要竞争对手。

英文摘要:

Deep neural networks are typically trained in a single shot for a specific task and data distribution, but in real world settings both the task and the domain of application can change. The problem becomes even more challenging in dense predictive tasks, such as semantic segmentation, and furthermore most approaches tackle the two problems separately. In this paper we introduce the novel task of coarse-to-fine learning of semantic segmentation architectures in presence of domain shift. We consider subsequent learning stages progressively refining the task at the semantic level; i.e., the finer set of semantic labels at each learning step is hierarchically derived from the coarser set of the previous step. We propose a new approach (CCDA) to tackle this scenario. First, we employ the maximum squares loss to align source and target domains and, at the same time, to balance the gradients between well-classified and harder samples. Second, we introduce a novel coarse-to-fine knowledge distillation constraint to transfer network capabilities acquired on a coarser set of labels to a set of finer labels. Finally, we design a coarse-to-fine weight initialization rule to spread the importance from each coarse class to the respective finer classes. To evaluate our approach, we design two benchmarks where source knowledge is extracted from the GTA5 dataset and it is transferred to either the Cityscapes or the IDD datasets, and we show how it outperforms the main competitors.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑