arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2512.03247cs.CV

PixPerfect: 基于判别像素空间的无缝潜在扩散局部编辑

PixPerfect: Seamless Latent Diffusion Local Editing with Discriminative Pixel-Space Refinement

Adobe Research(Adobe研究院);University of Rochester(罗切斯特大学)

Haitian Zheng, Yuan Yao, Yongsheng Yu, Yuqian Zhou, Jiebo Luo, Zhe Lin

AI总结:

PixPerfect通过判别像素空间和伪影模拟流程,实现跨不同LDM架构和任务的无缝高保真局部编辑。

摘要:

潜在扩散模型(LDMs)显著提升了图像修复和局部编辑的质量。然而,固有的潜在压缩常常引入像素级不一致,例如色偏、纹理不匹配以及沿编辑边界可见的缝线。现有解决方案,包括背景条件化的潜在解码和像素空间谐调,通常在实践中无法完全消除这些伪影,并且在不同潜在表示或任务之间泛化能力较差。我们引入PixPerfect,一种像素级细化框架,能够在多种LDM架构和任务中实现无缝、高保真的局部编辑。PixPerfect利用(i)一个可微的判别像素空间,放大和抑制细微的颜色和纹理差异,(ii)一个全面的伪影模拟流程,使细化器在训练期间接触现实的局部编辑伪影,以及(iii)一种直接的像素空间细化方案,确保在多种潜在表示和任务中具有广泛的适用性。在修复、物体移除和插入基准测试中的广泛实验表明,PixPerfect显著提高了感知保真度和下游编辑性能,为稳健且高保真的局部图像编辑建立了新标准。

英文摘要:

Latent Diffusion Models (LDMs) have markedly advanced the quality of image inpainting and local editing. However, the inherent latent compression often introduces pixel-level inconsistencies, such as chromatic shifts, texture mismatches, and visible seams along editing boundaries. Existing remedies, including background-conditioned latent decoding and pixel-space harmonization, usually fail to fully eliminate these artifacts in practice and do not generalize well across different latent representations or tasks. We introduce PixPerfect, a pixel-level refinement framework that delivers seamless, high-fidelity local edits across diverse LDM architectures and tasks. PixPerfect leverages (i) a differentiable discriminative pixel space that amplifies and suppresses subtle color and texture discrepancies, (ii) a comprehensive artifact simulation pipeline that exposes the refiner to realistic local editing artifacts during training, and (iii) a direct pixel-space refinement scheme that ensures broad applicability across diverse latent representations and tasks. Extensive experiments on inpainting, object removal, and insertion benchmarks demonstrate that PixPerfect substantially enhances perceptual fidelity and downstream editing performance, establishing a new standard for robust and high-fidelity localized image editing.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑