arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2303.02741cs.CV
收藏

IDA:信息域自适应语义分割

IDA: Informed Domain Adaptive Semantic Segmentation

Luddy School of Informatics, Computing, and Engineering, Indiana University(印第安纳大学卢迪信息、计算与工程学院);Tulane University(杜兰大学);DEVCOM Army Research Laboratory(美国陆军作战能力发展司令部陆军研究实验室)

Zheng Chen, Zhengming Ding, Jason M. Gregory, Lantao Liu

摘要:

基于混淆的数据增强已被验证为无监督域自适应语义分割(UDA-SS)自训练框架中的关键阶段,其目的是将知识从注释良好的(源)域转移到未标记的(目标)域。现有的自训练方法通常采用流行的基于区域的mixup技术与随机抽样策略,不幸的是,忽略了不同的语义在不同领域的训练过程中的动态演变。为了提高UDA-SS的性能,我们提出了一个知情的领域自适应(IDA)模型,一个自我训练的框架,混合数据的基础上类级分割性能,其目的是强调小区域语义在混合。在我们的IDA模型中,类级性能由预期置信度得分(ECS)跟踪。然后,我们使用一个动态的时间表,以确定不同领域的数据的混合比。大量的实验结果表明,我们提出的方法是能够优于国家的最先进的UDA-SS方法的利润率为1.1 mIoU的适应GTA-V的城市景观和0.9 mIoU的适应SYNTHIA的城市景观。

英文摘要:

Mixup-based data augmentation has been validated to be a critical stage in the self-training framework for unsupervised domain adaptive semantic segmentation (UDA-SS), which aims to transfer knowledge from a well-annotated (source) domain to an unlabeled (target) domain. Existing self-training methods usually adopt the popular region-based mixup techniques with a random sampling strategy, which unfortunately ignores the dynamic evolution of different semantics across various domains as training proceeds. To improve the UDA-SS performance, we propose an Informed Domain Adaptation (IDA) model, a self-training framework that mixes the data based on class-level segmentation performance, which aims to emphasize small-region semantics during mixup. In our IDA model, the class-level performance is tracked by an expected confidence score (ECS). We then use a dynamic schedule to determine the mixing ratio for data in different domains. Extensive experimental results reveal that our proposed method is able to outperform the state-of-the-art UDA-SS method by a margin of 1.1 mIoU in the adaptation of GTA-V to Cityscapes and of 0.9 mIoU in the adaptation of SYNTHIA to Cityscapes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑