arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1709.08019cs.AIcs.CV
收藏

半监督层次语义对象解析

Semi-Supervised Hierarchical Semantic Object Parsing

Amirkabir University of Technology(阿米尔卡比尔理工大学)

Jalal Mirakhorli, Hamidreza Amindavar

摘要:

基于卷积神经网络(CNN)的模型已经被证明对于产生特征层次的语义分割和对象解析非常成功。我们的关键见解是构建卷积网络,该网络可以接受任意大小的输入,并通过有效的推理和学习生成对象解析输出。在这项工作中,我们专注于实例分割和解析的任务,识别和定位对象到像素级的基础上深CNN。因此,与某些相关工作不同,一个像素不能属于多个实例和解析。我们的模型基于一个经过对象掩蔽训练的深度神经网络,该网络使用输入图像进行监督,并遵循基于对象解析输出的具有端到端可训练分段顺序势的条件随机场(CRF)。在每个CRF单元中,我们设计了术语来捕获来自各种邻居的短程和长程依赖性。我们的网络产生的准确的实例级分割反映在以前的工作在高APr阈值下获得的相当大的改进。我们证明了我们的模型的有效性,具有挑战性的PASCAL VOC 2012的数据集子集上进行了广泛的实验。

英文摘要:

Models based on Convolutional Neural Networks (CNNs) have been proven very successful for semantic segmentation and object parsing that yield hierarchies of features. Our key insight is to build convolutional networks that take input of arbitrary size and produce object parsing output with efficient inference and learning. In this work, we focus on the task of instance segmentation and parsing which recognizes and localizes objects down to a pixel level base on deep CNN. Therefore, unlike some related work, a pixel cannot belong to multiple instances and parsing. Our model is based on a deep neural network trained for object masking that supervised with input image and follow incorporates a Conditional Random Field (CRF) with end-to-end trainable piecewise order potentials based on object parsing outputs. In each CRF unit we designed terms to capture the short range and long range dependencies from various neighbors. The accurate instance-level segmentation that our network produce is reflected by the considerable improvements obtained over previous work at high APr thresholds. We demonstrate the effectiveness of our model with extensive experiments on challenging dataset subset of PASCAL VOC2012.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑