arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2108.06962cs.CV
收藏

语义分割领域自适应的多目标对抗框架

Multi-Target Adversarial Frameworks for Domain Adaptation in Semantic Segmentation

Sorbonne University(索邦大学)

Antoine Saporta, Tuan-Hung Vu, Matthieu Cord, Patrick Pérez

摘要:

在这项工作中,我们解决的任务无监督领域自适应(UDA)的语义分割存在多个目标域:目标是训练一个单一的模型,可以处理所有这些域在测试时。这种多目标适应对于现实世界的自主系统必须处理的各种场景至关重要。这是一个具有挑战性的设置,因为人们不仅面临着标记的源集合和未标记的目标集合之间的域间隙,而且还存在于后者内的不同目标域之间的分布偏移。为此,我们引入了两个对抗框架:(i)多目标,它明确地将每个目标域与其对应物对齐,以及(ii)多目标知识转移,它通过多教师/单学生蒸馏机制学习目标不可知的模型。评估是在语义分割中对UDA的四个新提出的多目标基准进行的。在所有测试场景中,我们的方法始终优于基线,为新任务设定了竞争标准。

英文摘要:

In this work, we address the task of unsupervised domain adaptation (UDA) for semantic segmentation in presence of multiple target domains: The objective is to train a single model that can handle all these domains at test time. Such a multi-target adaptation is crucial for a variety of scenarios that real-world autonomous systems must handle. It is a challenging setup since one faces not only the domain gap between the labeled source set and the unlabeled target set, but also the distribution shifts existing within the latter among the different target domains. To this end, we introduce two adversarial frameworks: (i) multi-discriminator, which explicitly aligns each target domain to its counterparts, and (ii) multi-target knowledge transfer, which learns a target-agnostic model thanks to a multi-teacher/single-student distillation mechanism.The evaluation is done on four newly-proposed multi-target benchmarks for UDA in semantic segmentation. In all tested scenarios, our approaches consistently outperform baselines, setting competitive standards for the novel task.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑