arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1706.02493cs.CV
收藏

使用语义上下文指导的监督学习场景标记的深度表示

Learning Deep Representations for Scene Labeling with Semantic Context Guided Supervision

The Chinese University of Hong Kong(香港中文大学)

Zhe Wang, Hongsheng Li, Wanli Ouyang, Xiaogang Wang

摘要:

场景标记是一个具有挑战性的分类问题,每个输入图像需要一个像素级的预测图。最近,基于深度学习的方法在解决这个问题上表现出了有效性。然而,我们认为,大的类内变化提供了模糊的训练信息,并阻碍了深度模型学习更具鉴别力的深度特征表示的能力。与主要利用语义上下文来正则化或平滑预测图的现有方法不同,我们从语义上下文设计了新的监督,以学习更好的深度特征表示。两种类型的语义上下文,场景名称的图像和标签地图统计的图像补丁,被利用来创建原始类和新创建的子类之间的标签层次结构作为学习监督。这样的子类显示出较低的类内变化,并帮助CNN检测更有意义的视觉模式并学习更有效的深度特征。新的训练策略和网络结构,利用这样的标签层次结构。我们提出的方法在四个流行的数据集上进行了广泛评估,斯坦福背景(8个类)、SIFTFlow(33个类)、巴塞罗那(170个类)和LM+Sun数据集(232个类),具有3种不同的网络结构,并显示出最先进的性能。实验表明,我们提出的方法使深度模型在不增加模型大小或复杂性的情况下学习更多有区别的特征表示。

英文摘要:

Scene labeling is a challenging classification problem where each input image requires a pixel-level prediction map. Recently, deep-learning-based methods have shown their effectiveness on solving this problem. However, we argue that the large intra-class variation provides ambiguous training information and hinders the deep models' ability to learn more discriminative deep feature representations. Unlike existing methods that mainly utilize semantic context for regularizing or smoothing the prediction map, we design novel supervisions from semantic context for learning better deep feature representations. Two types of semantic context, scene names of images and label map statistics of image patches, are exploited to create label hierarchies between the original classes and newly created subclasses as the learning supervisions. Such subclasses show lower intra-class variation, and help CNN detect more meaningful visual patterns and learn more effective deep features. Novel training strategies and network structure that take advantages of such label hierarchies are introduced. Our proposed method is evaluated extensively on four popular datasets, Stanford Background (8 classes), SIFTFlow (33 classes), Barcelona (170 classes) and LM+Sun datasets (232 classes) with 3 different networks structures, and show state-of-the-art performance. The experiments show that our proposed method makes deep models learn more discriminative feature representations without increasing model size or complexity.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑