arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.10428cs.CVcs.GRcs.LG

Large Scale Image Completion via Co-Modulated Generative Adversarial Networks

IIIS, Tsinghua University(清华大学交叉信息研究院);Microsoft Research(微软研究院);Vacaville Christian Schools(瓦卡维尔基督学校);The High School Affiliated to Renmin University of China(中国人民大学附属中学)

Shengyu Zhao, Jonathan Cui, Yilun Sheng, Yue Dong, Xiao Liang, Eric I Chang, Yan Xu

英文摘要:

Numerous task-specific variants of conditional generative adversarial networks have been developed for image completion. Yet, a serious limitation remains that all existing algorithms tend to fail when handling large-scale missing regions. To overcome this challenge, we propose a generic new approach that bridges the gap between image-conditional and recent modulated unconditional generative architectures via co-modulation of both conditional and stochastic style representations. Also, due to the lack of good quantitative metrics for image completion, we propose the new Paired/Unpaired Inception Discriminative Score (P-IDS/U-IDS), which robustly measures the perceptual fidelity of inpainted images compared to real images via linear separability in a feature space. Experiments demonstrate superior performance in terms of both quality and diversity over state-of-the-art methods in free-form image completion and easy generalization to image-to-image translation. Code is available at https://github.com/zsyzzsoft/co-mod-gan.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑