arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1802.01822cs.CV

Geometry-Contrastive GAN for Facial Expression Transfer

Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所)

Fengchun Qiao, Naiming Yao, Zirui Jiao, Zhihao Li, Hui Chen, Hongan Wang

英文摘要:

In this paper, we propose a Geometry-Contrastive Generative Adversarial Network (GC-GAN) for transferring continuous emotions across different subjects. Given an input face with certain emotion and a target facial expression from another subject, GC-GAN can generate an identity-preserving face with the target expression. Geometry information is introduced into cGANs as continuous conditions to guide the generation of facial expressions. In order to handle the misalignment across different subjects or emotions, contrastive learning is used to transform geometry manifold into an embedded semantic manifold of facial expressions. Therefore, the embedded geometry is injected into the latent space of GANs and control the emotion generation effectively. Experimental results demonstrate that our proposed method can be applied in facial expression transfer even there exist big differences in facial shapes and expressions between different subjects.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑