arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2004.14960cs.CV
收藏

通过自训练改进语义分割

Improving Semantic Segmentation via Self-Training

Amazon Web Services(亚马逊云科技);University of California, Davis(加州大学戴维斯分校)

Yi Zhu, Zhongyue Zhang, Chongruo Wu, Zhi Zhang, Tong He, Hang Zhang, R. Manmatha, Mu Li, Alexander Smola

摘要:

深度学习通常在完全监督的情况下达到最佳效果。在语义分割的情况下,这意味着需要大量的逐像素注释来学习准确的模型。在本文中,我们表明,我们可以获得国家的最先进的结果,使用半监督的方法,特别是自我训练的范例。我们首先在标记数据上训练教师模型,然后在大量未标记数据上生成伪标签。我们强大的训练框架可以联合消化人工注释和伪标签,并在Cityscapes,CamVid和KITTI数据集上实现最佳性能,同时需要更少的监督。我们还证明了自我训练在具有挑战性的跨领域泛化任务上的有效性,大大优于传统的微调方法。最后,为了减轻大量伪标签造成的计算负担,我们提出了一种快速训练计划,可以将分割模型的训练速度加快2倍,而不会降低性能。

英文摘要:

Deep learning usually achieves the best results with complete supervision. In the case of semantic segmentation, this means that large amounts of pixelwise annotations are required to learn accurate models. In this paper, we show that we can obtain state-of-the-art results using a semi-supervised approach, specifically a self-training paradigm. We first train a teacher model on labeled data, and then generate pseudo labels on a large set of unlabeled data. Our robust training framework can digest human-annotated and pseudo labels jointly and achieve top performances on Cityscapes, CamVid and KITTI datasets while requiring significantly less supervision. We also demonstrate the effectiveness of self-training on a challenging cross-domain generalization task, outperforming conventional finetuning method by a large margin. Lastly, to alleviate the computational burden caused by the large amount of pseudo labels, we propose a fast training schedule to accelerate the training of segmentation models by up to 2x without performance degradation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑