arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2605.30437cs.CV

通过结构细化减轻生成式AI图像编辑中的内容偏移和幻觉

Mitigating Content Shift and Hallucination in GenAI Image Editing via Structural Refinement

Department of Electrical Engineering & Computer Science(电气工程与计算机科学系)

Luxi Zhao, Michael S. Brown

AI总结:

提出一种后处理框架,通过建立粗空间和光度对应关系并融合输入图像与GenAI增强图像,在保留感知增强的同时抑制幻觉内容,从而解决黑盒GenAI图像编辑中的结构保持问题。

摘要:

生成式AI(GenAI)图像编辑器(如Nano Banana)在修图任务中产生视觉上令人满意的结果,使非专家能够仅通过文本提示编辑图像。然而,这些模型的生成性质常常引入空间错位、纹理失真和内容幻觉,这些都对需要像素级保真度的下游工作流程有害。我们为黑盒GenAI图像修图确定了一个称为“结构保持GenAI融合”的问题设置:在保持对原始输入图像的结构忠实性的同时,保留GenAI输出的感知增强。为了解决这个问题,我们提出了一种后处理框架,该框架首先建立粗空间和光度对应关系,然后执行融合阶段,将期望的增强转移同时抑制幻觉内容,从而将输入图像与其GenAI增强版本融合。在此设置中缺乏直接先前工作的情况下,我们针对来自真实感风格迁移和图像融合的代表性方法评估我们的框架。我们的实验表明,我们的方法在保持像素级结构一致性和输入分辨率的同时,更好地保留了美学质量。

英文摘要:

Generative AI (GenAI) image editors, such as Nano Banana, produce visually compelling results for retouching tasks, enabling non-experts to edit images through text prompts alone. However, the generative nature of these models often introduces spatial misalignment, texture distortion, and content hallucination, all of which are detrimental to downstream workflows that require pixel-level fidelity. We identify a problem setting we call "structure-preserving GenAI fusion" for black-box GenAI image retouching: retain the perceptual enhancements of a GenAI output while enforcing structural faithfulness to the original input image. To address this problem, we propose a post-processing framework that fuses an input image with its GenAI-enhanced counterpart by first establishing coarse spatial and photometric correspondences, then performing a fusion stage that transfers desired enhancements while suppressing hallucinated content. In the absence of direct prior work in this setting, we evaluate our framework against representative methods from photorealistic style transfer and image fusion. Our experiments demonstrate that our method better preserves aesthetic quality while maintaining pixel-level structural consistency and the input resolution.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑