arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2108.01344cs.CV
收藏

弱监督语义分割中的自适应仿射损失和错误伪标记精化

Adaptive Affinity Loss and Erroneous Pseudo-Label Refinement for Weakly Supervised Semantic Segmentation

Xidian University(西安电子科技大学);Xi’an Jiaotong University(西安交通大学);University of Leicester(莱斯特大学)

Xiangrong Zhang, Zelin Peng, Peng Zhu, Tianyang Zhang, Chen Li, Huiyu Zhou, Licheng Jiao

摘要:

语义分割在过去的十年中得到了不断的研究,并且大多数已建立的技术都是基于监督模型的。近年来,图像级弱监督语义分割(WSSS),包括单阶段和多阶段的过程,吸引了大量的关注,由于数据标记效率。在本文中,我们提出将多阶段方法的亲和学习嵌入到单阶段模型中。具体来说,我们引入了自适应的亲和力损失,以彻底学习局部成对亲和力。因此,深度神经网络用于在训练阶段传递全面的语义信息,同时提高最终预测模块的性能。另一方面,考虑到伪标签中存在错误,我们提出了一种新的标签重分配损失来减轻过拟合。在PASCAL VOC 2012数据集上进行了大量的实验,以评估我们提出的方法的有效性,该方法优于其他标准的单阶段方法,并与几种多阶段方法实现了相当的性能。

英文摘要:

Semantic segmentation has been continuously investigated in the last ten years, and majority of the established technologies are based on supervised models. In recent years, image-level weakly supervised semantic segmentation (WSSS), including single- and multi-stage process, has attracted large attention due to data labeling efficiency. In this paper, we propose to embed affinity learning of multi-stage approaches in a single-stage model. To be specific, we introduce an adaptive affinity loss to thoroughly learn the local pairwise affinity. As such, a deep neural network is used to deliver comprehensive semantic information in the training phase, whilst improving the performance of the final prediction module. On the other hand, considering the existence of errors in the pseudo labels, we propose a novel label reassign loss to mitigate over-fitting. Extensive experiments are conducted on the PASCAL VOC 2012 dataset to evaluate the effectiveness of our proposed approach that outperforms other standard single-stage methods and achieves comparable performance against several multi-stage methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑