arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1805.08704cs.CVcs.LGstat.ML
收藏

用生成器网络复制主动表观模型

Replicating Active Appearance Model by Generator Network

University of California, Los Angeles(加州大学洛杉矶分校);Beijing Institute of Technology(北京理工大学)

Tian Han, Jiawen Wu, Ying Nian Wu

摘要:

最近的一篇Cell论文[Chang和Tsao,2017]报道了一个有趣的发现。对于由预先训练的主动外观模型(AAM)生成的人脸刺激,灵长类动物大脑中负责人脸识别的区域中的神经元的反应与生成人脸刺激的AAM的形状变量和外观变量表现出强线性关系。在本文中,我们证明了这种行为可以通过一种称为生成器网络的深度生成模型来复制,该模型假设观察到的信号是由潜随机变量通过自上而下的卷积神经网络生成的。具体来说,我们使用变分自动编码器从预训练的AAM模型生成的人脸图像中学习生成器网络,并且我们证明了学习的生成器网络的推断潜变量与生成人脸图像的AAM模型的形状和外观变量具有很强的线性关系。与AAM模型不同,AAM模型具有显式形状模型,其中形状变量生成控制点或界标,生成器网络没有这样的形状模型和形状变量。然而,生成器网络可以学习形状知识,在这个意义上,学习的生成器网络的一些潜变量捕获由AAM生成的面部图像中的形状变化。

英文摘要:

A recent Cell paper [Chang and Tsao, 2017] reports an interesting discovery. For the face stimuli generated by a pre-trained active appearance model (AAM), the responses of neurons in the areas of the primate brain that are responsible for face recognition exhibit strong linear relationship with the shape variables and appearance variables of the AAM that generates the face stimuli. In this paper, we show that this behavior can be replicated by a deep generative model called the generator network, which assumes that the observed signals are generated by latent random variables via a top-down convolutional neural network. Specifically, we learn the generator network from the face images generated by a pre-trained AAM model using variational auto-encoder, and we show that the inferred latent variables of the learned generator network have strong linear relationship with the shape and appearance variables of the AAM model that generates the face images. Unlike the AAM model that has an explicit shape model where the shape variables generate the control points or landmarks, the generator network has no such shape model and shape variables. Yet the generator network can learn the shape knowledge in the sense that some of the latent variables of the learned generator network capture the shape variations in the face images generated by AAM.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑