In contrast to great success of memory-consuming face editing methods at a low resolution, to manipulate high-resolution (HR) facial images, i.e., typically larger than 7682 pixels, with very limited memory is still challenging. This is due to the reasons of 1) intractable huge demand of memory; 2) inefficient multi-scale features fusion. To address these issues, we propose a NOVEL pixel translation framework called Cooperative GAN(CooGAN) for HR facial image editing. This framework features a local path for fine-grained local facial patch generation (i.e., patch-level HR, LOW memory) and a global path for global lowresolution (LR) facial structure monitoring (i.e., image-level LR, LOW memory), which largely reduce memory requirements. Both paths work in a cooperative manner under a local-to-global consistency objective (i.e., for smooth stitching). In addition, we propose a lighter selective transfer unit for more efficient multi-scale features fusion, yielding higher fidelity facial attributes manipulation. Extensive experiments on CelebAHQ well demonstrate the memory efficiency as well as the high image generation quality of the proposed framework.
MagicFace: High-Fidelity Facial Expression Editing with Action-Unit Control
Center for Machine Vision and Signal Analysis, Faculty of Information Technology and Electrical Engineering, University of Oulu(机器视觉与信号分析中心,信息科技与电气工程学院,奥卢大学)
Shenyang Institute of Automation, Chinese Academy of Sciences(中国科学院沈阳自动化研究所);Institutes for Robotics and Intelligent Manufacturing(机器人与智能制造研究所);University of Chinese Academy of Sciences(中国科学院大学)
FED-Bench: A Cross-Granular Benchmark for Disentangled Evaluation of Facial Expression Editing
Xi’an Jiaotong University(西安交通大学);Northwestern Polytechnical University(西北工业大学);National University of Singapore(新加坡国立大学);Fudan University(复旦大学);Zhejiang Lab(之江实验室)
AttDiff-GAN: A Hybrid Diffusion-GAN Framework for Facial Attribute Editing
GuangDong Province Key Lab of Information Security Technology and School of Computer Science and Engineering(广东信息安全技术重点实验室和计算机科学与工程学院);School of Cyber Science and Technology, Shenzhen Campus(深圳校区网络科学与技术学院);Guangdong Laboratory of Machine Perception and Intelligent Computing, Faculty of Engineering(广东机器感知与智能计算实验室,工程学院)
Shanghai AI Laboratory(上海人工智能实验室);Nanyang Technological University(南洋理工大学);Monash University(莫纳什大学);SenseTime Research(商汤科技研究院);Hong Kong University of Science and Technology(香港科技大学)