We propose a simple but effective training-free approach tailored to diffusion-based image-to-image translation. Our approach revises the original noise prediction network of a pretrained diffusion model by introducing a noise correction term. We formulate the noise correction term as the difference between two noise predictions; one is computed from the denoising network with a progressive interpolation of the source and target prompt embeddings, while the other is the noise prediction with the source prompt embedding. The final noise prediction network is given by a linear combination of the standard denoising term and the noise correction term, where the former is designed to reconstruct must-be-preserved regions while the latter aims to effectively edit regions of interest relevant to the target prompt. Our approach can be easily incorporated into existing image-to-image translation methods based on diffusion models. Extensive experiments verify that the proposed technique achieves outstanding performance with low latency and consistently improves existing frameworks when combined with them.
Smooth image-to-image translations with latent space interpolations
University of Trento(特伦托大学);Fondazione Bruno Kessler(布鲁诺·凯斯勒基金会);University of Modena and Reggio Emilia(摩德纳-雷焦艾米利亚大学);Shanghai Jiao Tong University(上海交通大学);Tencent AI Lab(腾讯人工智能实验室)
Deep Network Interpolation for Continuous Imagery Effect Transition
The Chinese University of Hong Kong(香港中文大学);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Nanyang Technological University(南洋理工大学)
RichSpace: Enriching Text-to-Video Prompt Space via Text Embedding Interpolation
Zhejiang University(浙江大学);The University of Texas at Austin(德克萨斯大学奥斯汀分校);University of New South Wales(新南威尔士大学);The University of Hong Kong(香港大学);University of Wisconsin-Madison(威斯康星大学麦迪逊分校);Tsinghua University(清华大学);Simons Institute for the Theory of Computing, University of California, Berkeley(加州大学伯克利分校西蒙斯理论计算研究所)
Dual-branch Prompting for Multimodal Machine Translation
School of Computing and Artificial Intelligence, Southwest Jiaotong University(西南交通大学计算机与人工智能学院);School of Computer and Software Engineering, Xihua University(西华大学计算机与软件工程学院);School of Intelligent Medicine, Chengdu University of Traditional Chinese Medicine(成都中医药大学针灸推拿学院)
Language-Grounded Multi-Domain Image Translation via Semantic Difference Guidance
Department of Artificial Intelligence, Chung-Ang University(人工智能系, Chung-Ang 大学);Hyundai Mobis;Korea Advanced Institute of Science and Technology(韩国科学技术院)
Contrastive Learning Guided Latent Diffusion Model for Image-to-Image Translation
School of Computer Science and Information Engineering, Hefei University of Technology(合肥工业大学计算机与信息工程学院);Yunnan Key Laboratory of Software Engineering(云南省软件工程重点实验室);School of Computer Science and Engineering, Donghua University(东华大学计算机科学与技术学院);ByteDance(字节跳动);School of Computer and Artificial Intelligence, Zhengzhou University(郑州大学计算机与人工智能学院)
Enhanced Low-resolution LiDAR-Camera Calibration Via Depth Interpolation and Supervised Contrastive Learning
Arizona State University(亚利桑那州立大学);U.S. Army DEVCOM Research Laboratory(美国陆军作战能力发展司令部研究实验室);U.S. Army DEVCOM C5ISR Center(美国陆军作战能力发展司令部指挥、控制、通信、计算机、网络、情报、监视与侦察中心)