arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1506.09124cs.CV
收藏

多线索结构保持MRF的无约束视频分割

Multi-Cue Structure Preserving MRF for Unconstrained Video Segmentation

Rutgers, The State University of New Jersey(罗格斯新泽西州立大学)

Saehoon Yi, Vladimir Pavlovic

摘要:

视频分割是理解视频上下文的垫脚石。视频分割使人们能够通过将视频分解成包括对象的全部或部分的相干区域来表示视频。然而,这一挑战源于这样一个事实,即大多数视频分割算法是基于无监督学习,由于昂贵的成本像素视频注释和类内的变化,在类似的无约束视频类。我们提出了一个马尔可夫随机场模型的无约束视频分割,依赖于紧密集成的多个线索:顶点定义从基于轮廓的超像素,一元潜力从时间平滑标签的可能性和成对的潜力从全球结构的视频。多线索结构是在无监督的情况下提取无约束视频中相干对象区域的一个突破。我们在VSB 100数据集上的实验表明,该模型的性能显着优于竞争的最先进的算法。定性分析表明,该模型的视频分割结果与人类对对象的感知是一致的。

英文摘要:

Video segmentation is a stepping stone to understanding video context. Video segmentation enables one to represent a video by decomposing it into coherent regions which comprise whole or parts of objects. However, the challenge originates from the fact that most of the video segmentation algorithms are based on unsupervised learning due to expensive cost of pixelwise video annotation and intra-class variability within similar unconstrained video classes. We propose a Markov Random Field model for unconstrained video segmentation that relies on tight integration of multiple cues: vertices are defined from contour based superpixels, unary potentials from temporal smooth label likelihood and pairwise potentials from global structure of a video. Multi-cue structure is a breakthrough to extracting coherent object regions for unconstrained videos in absence of supervision. Our experiments on VSB100 dataset show that the proposed model significantly outperforms competing state-of-the-art algorithms. Qualitative analysis illustrates that video segmentation result of the proposed model is consistent with human perception of objects.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑