Visual prompt, a pair of before-and-after edited images, can convey indescribable imagery transformations and prosper in image editing. However, current visual prompt methods rely on a pretrained text-guided image-to-image generative model that requires a triplet of text, before, and after images for retraining over a text-to-image model. Such crafting triplets and retraining processes limit the scalability and generalization of editing. In this paper, we present a framework based on any single text-to-image model without reliance on the explicit image-to-image model thus enhancing the generalizability and scalability. Specifically, by leveraging the probability-flow ordinary equation, we construct a diffusion bridge to transfer the distribution between before-and-after images under the text guidance. By optimizing the text via the bridge, the framework adaptively textualizes the editing transformation conveyed by visual prompts into text embeddings without other models. Meanwhile, we introduce differential attention control during text optimization, which disentangles the text embedding from the invariance of the before-and-after images and makes it solely capture the delicate transformation and generalize to edit various images. Experiments on real images validate competitive results on the generalization, contextual coherence, and high fidelity for delicate editing with just one image pair as the visual prompt.
Preference Alignment on Diffusion Model: A Comprehensive Survey for Image Generation and Editing
University of Liverpool（利物浦大学）；Institute of Software Chinese Academy of Sciences（中国科学院软件研究所）；University of Edinburgh（爱丁堡大学）；University of Bristol（布里斯托大学）；University of Exeter（埃克塞特大学）
Beijing Academy of Artificial Intelligence（北京人工智能研究院）；University of Chinese Academy of Sciences（中国科学院大学）；Shenyang Institute of Computing Technology, Chinese Academy of Sciences（中国科学院沈阳计算技术研究所）；Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）
East China Normal University（华东师范大学）；Xiaohongshu Inc.（小红书）；KLATASDS, MOE, China（中国教育部统计与数据科学重点实验室）；The Chinese University of Hong Kong（香港中文大学）；Zhejiang University（浙江大学）；Fudan University（复旦大学）；University of Oxford（牛津大学）；Shanghai Jiao Tong University（上海交通大学）；University of Science and Technology of China（中国科学技术大学）；Nanjing University（南京大学）
LIVE: Leveraging Image Manipulation Priors for Instruction-based Video Editing
Nankai University（南开大学）；Pengcheng Laboratory（鹏城实验室）；Kuaishou Technology（快手科技）；Nankai International Advanced Research Institute (SHENZHEN·FUTIAN)（南开国际先进研究院（深圳·福田））
JAVEDIT: Joint Audio-Visual Instruction-Guided Video Editing with Agentic Data Curation
Zhejiang University（浙江大学）；Tencent Youtu Lab（腾讯优图实验室）；Nanjing University（南京大学）；University of Auckland（奥克兰大学）；Fudan University（复旦大学）；National University of Singapore（新加坡国立大学）
StreamEdit: Training-Free Video Editing via Few-Step Streaming Video Generation
The University of British Columbia（不列颠哥伦比亚大学）；ETH Zürich（苏黎世联邦理工学院）；McMaster University（麦马斯特大学）；Vector Institute（向量研究所）；Canada CIFAR AI Chair（加拿大 CIFAR 人工智能主席）
SceneCraft: Interactive System for Image Editing via Scene Graph
University of Science, Ho Chi Minh, Vietnam（胡志明市理科大学）；Vietnam National University, Ho Chi Minh, Vietnam（越南国家大学胡志明市）；University of Dayton, Dayton, Ohio, USA（代顿大学）
EDITBRIDGE: Towards Faithful and Efficient Ultra-High-Resolution Image Editing
School of Artificial Intelligence, Shanghai Jiao Tong University（上海交通大学人工智能学院）；Qwen Business Unit of Alibaba（阿里巴巴通义千问业务部）；National University of Singapore（新加坡国立大学）
Instruction-Guided Editing Controls for Images and Multimedia: A Survey in LLM era
Griffith University（格里菲斯大学）；University of Bremen（不来梅大学）；Ho Chi Minh City University of Technology（胡志明市技术大学）；École Polytechnique Fédérale de Lausanne（洛桑联邦理工学院）；Hanoi University of Science and Technology（河内科技大学）；The University of Queensland（昆士兰大学）
Imperial College London（帝国理工学院）；University College London（伦敦大学学院）；University of Sheffield（谢菲尔德大学）；Korea Advanced Institute of Science and Technology（韩国高等科学技术研究院）
Semantically guided conditional Generative Adversarial Networks (cGANs) have become a popular approach for face editing in recent years. However, most existing methods introduce semantic masks as direct conditional inputs to the generator and often require the target masks to perform the corresponding translation in the RGB space. We propose SeCGAN, a novel label-guided cGAN for editing face images utilising semantic information without the need to specify target semantic masks. During training, SeCGAN has two branches of generators and discriminators operating in parallel, with one trained to…
FED-Bench: A Cross-Granular Benchmark for Disentangled Evaluation of Facial Expression Editing
Xi’an Jiaotong University（西安交通大学）；Northwestern Polytechnical University（西北工业大学）；National University of Singapore（新加坡国立大学）；Fudan University（复旦大学）；Zhejiang Lab（之江实验室）
Beijing University of Posts and Telecommunications（北京邮电大学）；Kuaishou Technology（快手科技）
Text-driven image manipulation is developed since the vision-language model (CLIP) has been proposed. Previous work has adopted CLIP to design a text-image consistency-based objective to address this issue. However, these methods require either test-time optimization or image feature cluster analysis for single-mode manipulation direction. In this paper, we manage to achieve inference-time optimization-free diverse manipulation direction mining by bridging CLIP and StyleGAN through Latent Alignment (CSLA). More specifically, our efforts consist of three parts: 1) a data-free training strategy …
