Scene-agnostic visual inpainting remains very challenging despite progress in patch-based methods. Recently, Pathak et al. 2016 have introduced convolutional "context encoders" (CEs) for unsupervised feature learning through image completion tasks. With the additional help of adversarial training, CEs turned out to be a promising tool to complete complex structures in real inpainting problems. In the present paper we propose to push further this key ability by relying on perceptual reconstruction losses at training time. We show on a wide variety of visual scenes the merit of the approach for structural inpainting, and confirm it through a user study. Combined with the optimization-based refinement of Yang et al. 2016 with neural patches, our context encoder opens up new opportunities for prior-free visual inpainting.
MTADiffusion: Mask Text Alignment Diffusion Model for Object Inpainting
MT Lab, Meitu Inc(美图实验室,美图公司);National University of Singapore(新加坡国立大学);Department of Computer Science and Technology, BNRist, IDG/McGovern Institute for Brain Research, Tsinghua University(计算机科学与技术系,BNRist,IDG/McGovern脑科学研究院,清华大学)
GS-RoadPatching: Inpainting Gaussians via 3D Searching and Placing for Driving Scenes
Beijing Normal University China;Unmanned Vehicle Dept., Cainiao, Alibaba \& State Key Lab of CAD\&CG, Zhejiang University China;Unmanned Vehicle Dept., Cainiao, Alibaba China;Baidu China;State Key Lab of CAD\&CG, Zhejiang University China;Beijing Normal University;Unmanned Vehicle Dept., Cainiao, Alibaba \& State Key Lab of CAD\&CG, Zhejiang University;Unmanned Vehicle Dept., Cainiao, Alibaba;Baidu;State Key Lab of CAD\&CG, Zhejiang University
Patch-to-Global: Random Patch Diffusion for Globally Consistent Megapixel Artifact Inpainting in Whole Slide Images
Korea University College of Medicine(高丽大学医学院);Korea University Anam Hospital(高丽大学安岩医院);Seegene Medical Foundation(Seegene医学财团);Seoul National University(首尔大学);Ewha Womans University(梨花女子大学);The Catholic University of Korea(韩国天主教大学)
Denoising Diffusion Models for 3D Healthy Brain Tissue Inpainting
University Hospital Basel(巴塞尔大学医院);Helmholtz Center Munich(慕尼黑亥姆霍兹中心);Helmholtz AI(亥姆霍兹人工智能);Technical University of Munich(慕尼黑工业大学);University of Basel(巴塞尔大学);University of Zurich(苏黎世大学);Klinikum rechts der Isar(伊斯河畔医院);TranslaTUM - Central Institute for Translational Cancer Research(慕尼黑工业大学转化肿瘤学中央研究所(TranslaTUM))
Transformer based Pluralistic Image Completion with Reduced Information Loss
School of Computer Science and Technology, Beijing Institute of Technology(北京理工大学计算机科学与技术学院);School of Information Science and Technology, University of Science and Technology of China(中国科学技术大学信息科学技术学院);Microsoft Cloud AI(微软云人工智能部门);Wormpex AI Research LLC(Wormpex人工智能研究有限责任公司)
High-Fidelity Synthetic Transmission Electron Microscopy Image Generation Using Diffusion Probabilistic Models for Data-Limited Semiconductor Metrology
Chemnitz University of Technology, Chemnitz, Germany(化学工业大学,化学矿泉,德国);Interuniversity Microelectronics Centre (imec), Leuven, Belgium(大学微电子中心(imec),卢汶,比利时)