Image editing approaches with diffusion models have been rapidly developed, yet their applicability are subject to requirements such as specific editing types (e.g., foreground or background object editing, style transfer), multiple conditions (e.g., mask, sketch, caption), and time consuming fine-tuning of diffusion models. For alleviating these limitations and realizing efficient real image editing, we propose a novel editing technique that only requires an input image and target text for various editing types including non-rigid edits without fine-tuning diffusion model. Our method contains three novelties:(I) Target-text Inversion Schedule (TTIS) is designed to fine-tune the input target text embedding to achieve fast image reconstruction without image caption and acceleration of convergence.(II) Progressive Transition Scheme applies progressive linear interpolation between target text embedding and its fine-tuned version to generate transition embedding for maintaining non-rigid editing capability.(III) Balanced Attention Module (BAM) balances the tradeoff between textual description and image semantics.By the means of combining self-attention map from reconstruction process and cross-attention map from transition process, the guidance of target text embeddings in diffusion process is optimized.In order to demonstrate editing capability, effectiveness and efficiency of the proposed BARET, we have conducted extensive qualitative and quantitative experiments. Moreover, results derived from user study and ablation study further prove the superiority over other methods.
GenHOI: Towards Object-Consistent Hand-Object Interaction with Temporally Balanced and Spatially Selective Object Injection
Department of Computer Vision Technology(VIS), Baidu Inc.(百度公司计算机视觉技术部);Shenzhen Campus of Sun Yat-Sen University(中山大学深圳校区);Northwestern Polytechnical University(西北工业大学)
Tuning-Free Image Editing with Fidelity and Editability via Unified Latent Diffusion Model
Communication University of China(中国传媒大学);National University of Singapore(新加坡国立大学);University of California at Merced(加州大学默塞德分校);Yonsei University(延世大学)
GANalyzer: Analysis and Manipulation of GANs Latent Space for Controllable Face Synthesis
Ritchie School of Engineering and Computer Science, University of Denver(丹佛大学里奇工程与计算机科学学院);Department of Psychology, University of Tennessee(田纳西大学心理学系);College of Arts, Humanities and Social Sciences, University of Denver(丹佛大学艺术、人文与社会科学学院)
Digital Image Forgery Detection Using Transfer Learning
Marmara University, Department of Computer Engineering(马尔马拉大学计算机工程系);Loyola University Chicago, Department of Computer Science(芝加哥洛伊拉大学计算机科学系);Biruni University, Department of Computer Engineering(比鲁尼大学计算机工程系)
DailyBench: A Unified Benchmark for AI-Generated and Manipulated Images from Modern Generative Models
People’s Daily Online(人民网);Nanyang Technological University(南洋理工大学);Tongji University(同济大学);Nanjing University of Science and Technology(南京理工大学);National University of Singapore(新加坡国立大学);University of Science and Technology of China(中国科学技术大学)