高保真基于扩散的图像编辑
High-Fidelity Diffusion-based Image Editing
AI总结：
针对扩散模型图像编辑中因条件马尔可夫性质导致的误差累积问题，提出引入整流器模块调制权重并采用类去噪分数匹配的训练范式，实现高保真重建与编辑。
摘要：
扩散模型在图像生成和编辑领域取得了显著成功。人们普遍认为，在扩散模型中采用更大的反转和去噪步数能提升图像重建质量。然而，即使增加去噪步数，扩散模型的编辑性能仍不尽如人意。编辑上的不足可归因于编辑过程的条件马尔可夫性质，误差会在去噪步骤中不断累积。为应对这一挑战，我们首先提出一个创新框架，其中引入整流器模块以利用残差特征调制扩散模型权重，从而提供补偿信息以弥合保真度差距。此外，我们引入一种新的学习范式，旨在最小化编辑过程中的误差传播，其以类似于去噪分数匹配的方式训练编辑过程。大量实验表明，我们提出的框架和训练策略在各种去噪步数下均实现了高保真重建和编辑结果，同时在定量指标和定性评估方面均表现出卓越性能。此外，我们通过图像到图像转换和域外图像编辑等应用探索了模型的泛化能力。
英文摘要：
Diffusion models have attained remarkable success in the domains of image generation and editing. It is widely recognized that employing larger inversion and denoising steps in diffusion model leads to improved image reconstruction quality. However, the editing performance of diffusion models tends to be no more satisfactory even with increasing denoising steps. The deficiency in editing could be attributed to the conditional Markovian property of the editing process, where errors accumulate throughout denoising steps. To tackle this challenge, we first propose an innovative framework where a rectifier module is incorporated to modulate diffusion model weights with residual features, thereby providing compensatory information to bridge the fidelity gap. Furthermore, we introduce a novel learning paradigm aimed at minimizing error propagation during the editing process, which trains the editing procedure in a manner similar to denoising score-matching. Extensive experiments demonstrate that our proposed framework and training strategy achieve high-fidelity reconstruction and editing results across various levels of denoising steps, meanwhile exhibits exceptional performance in terms of both quantitative metric and qualitative assessments. Moreover, we explore our model's generalization through several applications like image-to-image translation and out-of-domain image editing.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
