arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2607.07051cs.CVcs.AI

在对话式图像编辑中明确隐式保留意图

Making Implicit Preservation Intent Explicit in Conversational Image Editing

Sogang University(西江大学);Korea University(高丽大学);Chung-Ang University(中央大学)

Soomin Han, Jihyung Ahn, Bumsoo Kim, Buru Chang

AI总结:

研究对话式图像编辑中隐式保留意图的问题,提出无需训练的ReSpec框架,通过配对恢复感知指令与历史视觉参考使隐式保留明确化,实验显示该框架提升了恢复保真度和时间一致性。

摘要:

对话式图像编辑不仅需要保留可见内容,还需保留跨轮次暂时消失的内容。当新添加或修改的内容遮挡先前可见区域时,若该区域未发生语义变化则应重新出现。然而,现有系统常无法恢复此类被遮挡但未改变的内容,导致结果不一致或产生幻觉。我们引入了OCCUR - Bench,一个用于对话式图像编辑中时间保留的诊断基准。它提供多样的遮挡和揭示场景及历史恢复参考,能评估忠实恢复而非合理生成。我们还提出了ReSpec,一个无需训练的框架,通过将恢复感知指令与历史视觉参考配对来使隐式保留明确化。实验表明ReSpec提高了在OCCUR - Bench上的恢复保真度和时间一致性,强调了在编辑历史而非仅当前图像中进行保留的必要性。

英文摘要:

Conversational image editing requires preserving not only visible content, but also content that temporarily disappears across turns. When newly added or modified content occludes a previously visible region, that region should reappear if it was never semantically changed. However, existing systems often fail to recover such occluded-but-unchanged content, producing inconsistent or hallucinated results. We introduce OCCUR-Bench, a diagnostic benchmark for temporal preservation in conversational image editing. OCCUR-Bench provides diverse occlusion-and-revelation scenarios with historical restoration references, enabling evaluation of faithful restoration rather than plausible regeneration. We also propose ReSpec, a training-free framework that makes implicit preservation explicit by pairing restoration-aware instructions with historical visual references. Given an editing history, ReSpec identifies what should persist, selects the historical image state that provides missing visual evidence, and conditions an in-context editor on the resulting instruction and reference image. Experiments show that ReSpec improves restoration fidelity and temporal consistency on OCCUR-Bench, highlighting the need to ground preservation in editing history rather than only the current image.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑