首页/论文/2001.01870

arXiv 2001.018702020-01cs.CVcs.GRcs.LGeess.IV

MW-GAN: Multi-Warping GAN for Caricature Generation with Multi-Style Geometric Exaggeration

State Key Laboratory for Novel Software Technology, Nanjing University（南京大学计算机软件新技术国家重点实验室）；School of Computer Science & Informatics, Cardiff University（卡迪夫大学计算机科学与信息学院）

Haodi Hou, Jing Huo, Jing Wu, Yu-Kun Lai, Yang Gao

DOI：: 10.1109/TIP.2021.3118984

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

英文摘要相关论文

英文摘要：

Given an input face photo, the goal of caricature generation is to produce stylized, exaggerated caricatures that share the same identity as the photo. It requires simultaneous style transfer and shape exaggeration with rich diversity, and meanwhile preserving the identity of the input. To address this challenging problem, we propose a novel framework called Multi-Warping GAN (MW-GAN), including a style network and a geometric network that are designed to conduct style transfer and geometric exaggeration respectively. We bridge the gap between the style and landmarks of an image with corresponding latent code spaces by a dual way design, so as to generate caricatures with arbitrary styles and geometric exaggeration, which can be specified either through random sampling of latent code or from a given caricature sample. Besides, we apply identity preserving loss to both image space and landmark space, leading to a great improvement in quality of generated caricatures. Experiments show that caricatures generated by MW-GAN have better quality than existing methods.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

CariMe: Unpaired Caricature Generation with Multiple Exaggerations

Nanjing University（南京大学）

Caricature generation aims to translate real photos into caricatures with artistic styles and shape exaggerations while maintaining the identity of the subject. Different from the generic image-to-image translation, drawing a caricature automatically is a more challenging task due to the existence of various spacial deformations. Previous caricature generation methods are obsessed with predicting definite image warping from a given photo while ignoring the intrinsic representation and distribution for exaggerations in caricatures. This limits their ability on diverse exaggeration generation. I…

2020-10-01cs.CVcs.LGcs.MM

基于风格转换的高质量人脸漫画

High-Quality Face Caricature via Style Translation

提出一种基于GAN模型和非配对数据的高质量人脸漫画生成与投影方法，通过两步过程实现面部特征夸张与外观风格化，并有效保留身份属性和处理遮挡，展现出更高的真实感与鲁棒性。

2023-11-22cs.CV

CariGANs: Unpaired Photo-to-Caricature Translation

Tsinghua University（清华大学）；City University of Hong Kong（香港城市大学）；Microsoft Research（微软研究院）；Microsoft Research Asia（微软亚洲研究院）；Microsoft AI Perception and Mixed Reality（微软人工智能感知与混合现实部门）

Facial caricature is an art form of drawing faces in an exaggerated way to convey humor or sarcasm. In this paper, we propose the first Generative Adversarial Network (GAN) for unpaired photo-to-caricature translation, which we call "CariGANs". It explicitly models geometric exaggeration and appearance stylization using two components: CariGeoGAN, which only models the geometry-to-geometry transformation from face photos to caricatures, and CariStyGAN, which transfers the style appearance from caricatures to face photos without any geometry deformation. In this way, a difficult cross-domain tr…

2018-11-02cs.AIcs.CVcs.GR

CariGAN: Caricature Generation through Weakly Paired Adversarial Learning

University of Rochester（罗切斯特大学）；Nanjing University（南京大学）

Caricature generation is an interesting yet challenging task. The primary goal is to generate plausible caricatures with reasonable exaggerations given face images. Conventional caricature generation approaches mainly use low-level geometric transformations such as image warping to generate exaggerated images, which lack richness and diversity in terms of content and style. The recent progress in generative adversarial networks (GANs) makes it possible to learn an image-to-image transformation from data, so that richer contents and styles can be generated. However, directly applying the GAN-ba…

2018-11-20cs.CV

Modeling Caricature Expressions by 3D Blendshape and Dynamic Texture

University of Science and Technology of China（中国科学技术大学）；Nanyang Technological University（南洋理工大学）；Monash University（蒙纳士大学）

The problem of deforming an artist-drawn caricature according to a given normal face expression is of interest in applications such as social media, animation and entertainment. This paper presents a solution to the problem, with an emphasis on enhancing the ability to create desired expressions and meanwhile preserve the identity exaggeration style of the caricature, which imposes challenges due to the complicated nature of caricatures. The key of our solution is a novel method to model caricature expression, which extends traditional 3DMM representation to caricature domain. The method consi…

2020-08-13cs.CV

Unpaired Photo-to-Caricature Translation on Faces in the Wild

Ocean University of China（中国海洋大学）

Recently, image-to-image translation has been made much progress owing to the success of conditional Generative Adversarial Networks (cGANs). And some unpaired methods based on cycle consistency loss such as DualGAN, CycleGAN and DiscoGAN are really popular. However, it's still very challenging for translation tasks with the requirement of high-level visual information conversion, such as photo-to-caricature translation that requires satire, exaggeration, lifelikeness and artistry. We present an approach for learning to translate faces in the wild from the source photo domain to the target car…

2018-07-25cs.CV

更多相关论文收起更多论文

StyleCariGAN: Caricature Generation via StyleGAN Feature Map Modulation

POSTECH（浦项科技大学）；Microsoft Research Asia（微软亚洲研究院）

We present a caricature generation framework based on shape and style manipulation using StyleGAN. Our framework, dubbed StyleCariGAN, automatically creates a realistic and detailed caricature from an input photo with optional controls on shape exaggeration degree and color stylization type. The key component of our method is shape exaggeration blocks that are used for modulating coarse layer feature maps of StyleGAN to produce desirable caricature shape exaggerations. We first build a layer-mixed StyleGAN for photo-to-caricature style conversion by swapping fine layers of the StyleGAN for pho…

2021-07-09cs.CVcs.GR

Learning to Caricature via Semantic Shape Transform

State Key Lab of CAD&CG, Zhejiang University（浙江大学CAD&CG国家重点实验室）；University of California, Merced（加州大学默塞德分校）；NEC Laboratories America（NEC美国实验室）；Tencent Youtu Lab（腾讯优图实验室）；Adobe Research（Adobe研究院）

Caricature is an artistic drawing created to abstract or exaggerate facial features of a person. Rendering visually pleasing caricatures is a difficult task that requires professional skills, and thus it is of great interest to design a method to automatically generate such drawings. To deal with large shape changes, we propose an algorithm based on a semantic shape transform to produce diverse and plausible shape exaggerations. Specifically, we predict pixel-wise semantic correspondences and perform image warping on the input photo to achieve dense shape transformation. We show that the propo…

2020-08-13cs.CV

WarpGAN: Automatic Caricature Generation

Michigan State University（密歇根州立大学）

We propose, WarpGAN, a fully automatic network that can generate caricatures given an input face photo. Besides transferring rich texture styles, WarpGAN learns to automatically predict a set of control points that can warp the photo into a caricature, while preserving identity. We introduce an identity-preserving adversarial loss that aids the discriminator to distinguish between different subjects. Moreover, WarpGAN allows customization of the generated caricatures by controlling the exaggeration extent and the visual styles. Experimental results on a public domain dataset, WebCaricature, sh…

2019-04-16cs.CV

AutoToon: Automatic Geometric Warping for Face Cartoon Generation

Stanford University（斯坦福大学）；Adobe Research（Adobe研究院）

Caricature, a type of exaggerated artistic portrait, amplifies the distinctive, yet nuanced traits of human faces. This task is typically left to artists, as it has proven difficult to capture subjects' unique characteristics well using automated methods. Recent development of deep end-to-end methods has achieved promising results in capturing style and higher-level exaggerations. However, a key part of caricatures, face warping, has remained challenging for these systems. In this work, we propose AutoToon, the first supervised deep learning method that yields high-quality warps for the warpin…

2020-04-06cs.CV

Unsupervised Contrastive Photo-to-Caricature Translation based on Auto-distortion

Anhui University（安徽大学）；University of Chinese Academy of Sciences（中国科学院大学）

Photo-to-caricature translation aims to synthesize the caricature as a rendered image exaggerating the features through sketching, pencil strokes, or other artistic drawings. Style rendering and geometry deformation are the most important aspects in photo-to-caricature translation task. To take both into consideration, we propose an unsupervised contrastive photo-to-caricature translation architecture. Considering the intuitive artifacts in the existing methods, we propose a contrastive style loss for style rendering to enforce the similarity between the style of rendered photo and the caricat…

2020-11-10cs.CV