LAMS-Edit: 基于调度器的潜在与注意力混合用于改进扩散模型图像和风格编辑中的内容保留
LAMS-Edit: Latent and Attention Mixing with Schedulers for Improved Content Preservation in Diffusion-Based Image and Style Editing
AI总结:
LAMS-Edit通过调度器结合潜在表示和注意力图,实现扩散模型中更精确的内容保留与编辑应用,支持区域掩码编辑和风格迁移。
摘要:
基于扩散模型的文本到图像编辑在平衡内容保留与编辑应用以及处理真实图像编辑方面面临挑战。为了解决这些问题,我们提出了LAMS-Edit,利用倒置过程中的中间状态--真实图像编辑中的关键步骤--在编辑图像生成过程中。具体而言,通过加权插值将两个过程的潜在表示和注意力图在每一步结合,该过程由调度器控制。这种技术,即调度器的潜在与注意力混合(LAMS),与Prompt-to-Prompt(P2P)结合形成LAMS-Edit--一个可扩展的框架,支持通过区域掩码进行精确编辑,并通过LoRA实现风格迁移。广泛的实验表明,LAMS-Edit有效平衡了内容保留与编辑应用。
英文摘要:
Text-to-Image editing using diffusion models faces challenges in balancing content preservation with edit application and handling real-image editing. To address these, we propose LAMS-Edit, leveraging intermediate states from the inversion process--an essential step in real-image editing--during edited image generation. Specifically, latent representations and attention maps from both processes are combined at each step using weighted interpolation, controlled by a scheduler. This technique, Latent and Attention Mixing with Schedulers (LAMS), integrates with Prompt-to-Prompt (P2P) to form LAMS-Edit--an extensible framework that supports precise editing with region masks and enables style transfer via LoRA. Extensive experiments demonstrate that LAMS-Edit effectively balances content preservation and edit application.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。