arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1502.00743cs.CV
收藏

面向通用对象提取的深度联合任务学习

Deep Joint Task Learning for Generic Object Extraction

Sun Yat-sen University(中山大学);Carnegie Mellon University(卡内基梅隆大学);SYSU-CMU Shunde International Joint Research Institute(中山大学-卡内基梅隆大学顺德国际联合研究院);Harbin Institute of Technology(哈尔滨工业大学)

Xiaolong Wang, Liliang Zhang, Liang Lin, Zhujin Liang, Wangmeng Zuo

摘要:

本文研究了如何在不依赖手工特征和滑动窗口方法的情况下提取感兴趣的对象,其目的是联合解决两个子任务:(i)从图像中快速定位显著对象,以及(ii)基于定位准确分割对象。我们提出了一个通用的联合任务学习框架,其中每个任务(对象定位或对象分割)都是通过多层卷积神经网络处理的,两个网络协同工作以提高性能。特别是,我们建议将潜在变量桥接两个网络的联合优化方式。第一个网络直接从原始图像中预测显著对象的位置和尺度,潜变量调整对象定位以馈送产生像素对象掩码的第二个网络。EM型方法的优化,迭代两个步骤:(i)通过使用这两个网络,它估计的潜变量,采用MCMC为基础的采样方法;(ii)它优化的参数,通过反向传播联合两个网络,与固定的潜变量。大量的实验表明,我们的框架在准确性和效率方面明显优于其他最先进的方法(例如,比竞争方法快1000倍)。

英文摘要:

This paper investigates how to extract objects-of-interest without relying on hand-craft features and sliding windows approaches, that aims to jointly solve two sub-tasks: (i) rapidly localizing salient objects from images, and (ii) accurately segmenting the objects based on the localizations. We present a general joint task learning framework, in which each task (either object localization or object segmentation) is tackled via a multi-layer convolutional neural network, and the two networks work collaboratively to boost performance. In particular, we propose to incorporate latent variables bridging the two networks in a joint optimization manner. The first network directly predicts the positions and scales of salient objects from raw images, and the latent variables adjust the object localizations to feed the second network that produces pixelwise object masks. An EM-type method is presented for the optimization, iterating with two steps: (i) by using the two networks, it estimates the latent variables by employing an MCMC-based sampling method; (ii) it optimizes the parameters of the two networks unitedly via back propagation, with the fixed latent variables. Extensive experiments suggest that our framework significantly outperforms other state-of-the-art approaches in both accuracy and efficiency (e.g. 1000 times faster than competing approaches).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑