arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1704.02166cs.CV
收藏

半潜伏GAN:学习根据属性生成和修改面部图像

Semi-Latent GAN: Learning to generate and modify facial images from attributes

Fudan University(复旦大学);Disney Research(迪士尼研究院)

Weidong Yin, Yanwei Fu, Leonid Sigal, Xiangyang Xue

摘要:

使用高级属性控制生成和操纵人脸图像是重要而有趣的问题。在以前的工作中提出的模型可以解决这两个问题(生成或操作)之一,但不能同时解决。本文提出了一种新的模型,学习如何生成和修改的面部图像从高层次的语义属性。我们的核心思想是制定一个半潜在的面部属性空间(SL-FAS),系统地学习用户定义的属性和潜在的属性之间的关系,以及这些属性和RGB图像之间的关系。作为这个新定义的空间的一部分,我们提出了一个新的模型-- SL-GAN,它是生成对抗网络的一种特殊形式。最后,我们提出了一个迭代的SL-GAN训练算法。在最近的CelebA和CASIA-WebFace数据集上的实验验证了我们提出的框架的有效性。我们还将提供数据、预训练模型和代码。

英文摘要:

Generating and manipulating human facial images using high-level attributal controls are important and interesting problems. The models proposed in previous work can solve one of these two problems (generation or manipulation), but not both coherently. This paper proposes a novel model that learns how to both generate and modify the facial image from high-level semantic attributes. Our key idea is to formulate a Semi-Latent Facial Attribute Space (SL-FAS) to systematically learn relationship between user-defined and latent attributes, as well as between those attributes and RGB imagery. As part of this newly formulated space, we propose a new model --- SL-GAN which is a specific form of Generative Adversarial Network. Finally, we present an iterative training algorithm for SL-GAN. The experiments on recent CelebA and CASIA-WebFace datasets validate the effectiveness of our proposed framework. We will also make data, pre-trained models and code available.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑