arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2203.17266cs.CVcs.LG

TransEditor: Transformer-Based Dual-Space GAN for Highly Controllable Facial Editing

Shanghai AI Laboratory(上海人工智能实验室);Nanyang Technological University(南洋理工大学);Monash University(莫纳什大学);SenseTime Research(商汤科技研究院);Hong Kong University of Science and Technology(香港科技大学)

Yanbo Xu, Yueqin Yin, Liming Jiang, Qianyi Wu, Chengyao Zheng, Chen Change Loy, Bo Dai, Wayne Wu

英文摘要:

Recent advances like StyleGAN have promoted the growth of controllable facial editing. To address its core challenge of attribute decoupling in a single latent space, attempts have been made to adopt dual-space GAN for better disentanglement of style and content representations. Nonetheless, these methods are still incompetent to obtain plausible editing results with high controllability, especially for complicated attributes. In this study, we highlight the importance of interaction in a dual-space GAN for more controllable editing. We propose TransEditor, a novel Transformer-based framework to enhance such interaction. Besides, we develop a new dual-space editing and inversion strategy to provide additional editing flexibility. Extensive experiments demonstrate the superiority of the proposed framework in image quality and editing capability, suggesting the effectiveness of TransEditor for highly controllable facial editing.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑