arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1407.1339cs.CVcs.AIstat.ML
收藏

概率CAD模型的逆图

Inverse Graphics with Probabilistic CAD Models

MIT(麻省理工学院);Microsoft Research Cambridge(微软研究院剑桥实验室)

Tejas D. Kulkarni, Vikash K. Mansinghka, Pushmeet Kohli, Joshua B. Tenenbaum

摘要:

最近,基于计算机图形学的生成模型的概率反演的视觉问题的多种配方已经被提出。然而,从自然图像的3D感知的应用程序集中在低维的潜在场景,由于建模和推理的挑战。通过逼真的生成模型来解释3D对象形状和2D外观的巨大变化似乎很难,甚至将3D场景与2D图像链接的多对多计算的简单版本进行反演也是如此。本文提出并评估了解决这两个挑战的关键方面的方法。我们表明,它是可能的,以解决具有挑战性的,现实世界的3D视觉问题的近似推理生成模型的图像的基础上渲染的概率CAD(PCAD)程序的输出。我们的PCAD对象几何先验生成对应于合理对象的可变形3D网格,并应用仿射变换将它们放置在场景中。图像似然度基于特征空间中的相似性,该特征空间基于视觉文献中的标准中级图像表示。我们的推理算法集成了单站点和局部阻塞Metropolis-Hastings建议,Hamilton Monte Carlo和歧视性数据驱动的建议,从我们的模型生成的训练数据中学习。我们将这种方法应用于3D人体姿态估计和物体形状重建从单一的图像,实现定量和定性的性能改进超过国家的最先进的基线。

英文摘要:

Recently, multiple formulations of vision problems as probabilistic inversions of generative models based on computer graphics have been proposed. However, applications to 3D perception from natural images have focused on low-dimensional latent scenes, due to challenges in both modeling and inference. Accounting for the enormous variability in 3D object shape and 2D appearance via realistic generative models seems intractable, as does inverting even simple versions of the many-to-many computations that link 3D scenes to 2D images. This paper proposes and evaluates an approach that addresses key aspects of both these challenges. We show that it is possible to solve challenging, real-world 3D vision problems by approximate inference in generative models for images based on rendering the outputs of probabilistic CAD (PCAD) programs. Our PCAD object geometry priors generate deformable 3D meshes corresponding to plausible objects and apply affine transformations to place them in a scene. Image likelihoods are based on similarity in a feature space based on standard mid-level image representations from the vision literature. Our inference algorithm integrates single-site and locally blocked Metropolis-Hastings proposals, Hamiltonian Monte Carlo and discriminative data-driven proposals learned from training data generated from our models. We apply this approach to 3D human pose estimation and object shape reconstruction from single images, achieving quantitative and qualitative performance improvements over state-of-the-art baselines.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑