arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1503.02391cs.CV
收藏

使用主动模板回归的深度人类解析

Deep Human Parsing with Active Template Regression

Sun Yat-sen University(中山大学);National University of Singapore(新加坡国立大学);SYSU-CMU Shunde International Joint Research Institute(中山大学-卡内基梅隆大学顺德国际联合研究院);Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所)

Xiaodan Liang, Si Liu, Xiaohui Shen, Jianchao Yang, Luoqi Liu, Jian Dong, Liang Lin, Shuicheng Yan

摘要:

在这项工作中,人的解析任务,即分解成语义的时尚/身体区域的人的图像,制定为主动模板回归(ATR)问题,其中每个时尚/身体项目的归一化掩码表示为学习的掩码模板的线性组合,然后变形到一个更精确的掩码与活动的形状参数,包括每个语义区域的位置,规模和可见性。掩码模板系数和活动形状参数一起可以生成人类句法分析结果,因此被称为人类句法分析的结构输出。利用深度卷积神经网络(CNN)在输入的人类图像和用于人类解析的结构输出之间建立端到端关系。更具体地说,结构输出由两个独立的网络预测。第一个CNN网络具有最大池化,并被设计为预测每个标签掩码的模板系数,而第二个CNN网络没有最大池化,以保持对标签掩码位置的敏感性并准确地预测活动形状参数。对于一幅新的图像,融合两个网络的结构输出,生成每个像素的标签概率,最后使用超像素平滑来细化人工解析结果。一个大的数据集上的综合评价很好地证明了显着的优越性ATR框架比其他国家的最先进的人类解析。特别地,F1分数通过我们的ATR框架达到$64.38\%$,显著高于基于最先进算法的$44.76\%$。

英文摘要:

In this work, the human parsing task, namely decomposing a human image into semantic fashion/body regions, is formulated as an Active Template Regression (ATR) problem, where the normalized mask of each fashion/body item is expressed as the linear combination of the learned mask templates, and then morphed to a more precise mask with the active shape parameters, including position, scale and visibility of each semantic region. The mask template coefficients and the active shape parameters together can generate the human parsing results, and are thus called the structure outputs for human parsing. The deep Convolutional Neural Network (CNN) is utilized to build the end-to-end relation between the input human image and the structure outputs for human parsing. More specifically, the structure outputs are predicted by two separate networks. The first CNN network is with max-pooling, and designed to predict the template coefficients for each label mask, while the second CNN network is without max-pooling to preserve sensitivity to label mask position and accurately predict the active shape parameters. For a new image, the structure outputs of the two networks are fused to generate the probability of each label for each pixel, and super-pixel smoothing is finally used to refine the human parsing result. Comprehensive evaluations on a large dataset well demonstrate the significant superiority of the ATR framework over other state-of-the-arts for human parsing. In particular, the F1-score reaches $64.38\%$ by our ATR framework, significantly higher than $44.76\%$ based on the state-of-the-art algorithm.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑