arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.05180cs.CV

MIRAGE:多实例图像编辑的基准测试与对齐

MIRAGE: Benchmarking and Aligning Multi-Instance Image Editing

LTCI, Télécom Paris, Institut Polytechnique de Paris, France(法国巴黎理工学院电信巴黎分校LTCI实验室)

Ziqian Liu, Stephan Alaniz

AI总结:

本文提出MIRAGE框架,通过多分支并行去噪策略实现精确多实例编辑,解决现有方法在多实例和复合指令下的过度编辑和空间错位问题。

摘要:

指导式图像编辑通过FLUX.2和Qwen-Image-Edit等模型取得显著进展,但仍然难以处理包含多个相似实例的复杂场景。我们发现,最先进的模型在面对多个相同实例和复合指令时会出现严重的过度编辑和空间错位问题。为此,我们引入了一个专门用于评估多实例和多指令设置下细粒度一致性的综合基准。为了解决我们在基准中观察到的现有方法的失败,我们提出了一种无需训练的框架,即通过引导编辑进行多实例区域对齐(MIRAGE),该框架能够实现精确的局部编辑。通过利用视觉-语言模型将复杂指令解析为区域子集,MIRAGE采用多分支并行去噪策略。该方法将目标区域的潜在表示注入到全局表示空间中,同时通过参考轨迹保持背景完整性。在MIRA-Bench和RefEdit-Bench上的大量评估表明,我们的框架在实现精确实例级修改的同时,能够保持背景一致性,显著优于现有方法。我们的基准和代码可在https://github.com/ZiqianLiu666/MIRAGE上获得。

英文摘要:

Instruction-guided image editing has seen remarkable progress with models like FLUX.2 and Qwen-Image-Edit, yet they still struggle with complex scenarios with multiple similar instances each requiring individual edits. We observe that state-of-the-art models suffer from severe over-editing and spatial misalignment when faced with multiple identical instances and composite instructions. To this end, we introduce a comprehensive benchmark specifically designed to evaluate fine-grained consistency in multi-instance and multi-instruction settings. To address the failures of existing methods observed in our benchmark, we propose Multi-Instance Regional Alignment via Guided Editing (MIRAGE), a training-free framework that enables precise, localized editing. By leveraging a vision-language model to parse complex instructions into regional subsets, MIRAGE employs a multi-branch parallel denoising strategy. This approach injects latent representations of target regions into the global representation space while maintaining background integrity through a reference trajectory. Extensive evaluations on MIRA-Bench and RefEdit-Bench demonstrate that our framework significantly outperforms existing methods in achieving precise instance-level modifications while preserving background consistency. Our benchmark and code are available at https://github.com/ZiqianLiu666/MIRAGE.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑