arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2511.01295cs.CV

UniREditBench: 一个基于推理的图像编辑统一基准

UniREditBench: A Unified Reasoning-based Image Editing Benchmark

Fudan University(复旦大学);Shanghai Innovation Institute(上海创新研究院);Zhejiang University(浙江大学);UC Berkeley(伯克利大学)

Feng Han, Yibin Wang, Chenglin Li, Zheming Liang, Dianyi Wang, Yang Jiao, Zhipeng Wei, Chao Gong, Cheng Jin, Jiaqi Wang

AI总结:

UniREditBench通过多模态双参考评估和大规模合成数据集,提升图像编辑模型在复杂推理场景中的评估可靠性与性能表现。

摘要:

近期多模态生成模型的进步推动了图像编辑领域显著改进。然而,当前生成模型在处理需要隐式推理的多样化和复杂图像编辑任务时仍存在困难,凸显了需要一个全面基准来系统评估其在各种推理场景中的性能的必要性。现有基准主要集中在现实场景中的单对象属性转换,虽然有效,但面临两个关键挑战:(1)它们大多忽略了多对象互动以及涉及人类定义规则的游戏世界场景,这些在现实应用中很常见;(2)它们仅依赖文本参考来评估生成图像,可能导致系统性误判,特别是在复杂推理场景中。为此,本文提出了UniREditBench,一个用于推理基于图像编辑评估的统一基准。它包含2700个精心挑选的样本,涵盖8个主要维度和18个子维度的现实和游戏世界场景。为了提高评估可靠性,我们引入了多模态双参考评估,为每个样本评估提供文本和地面真实图像参考。此外,我们设计了一个自动化多场景数据合成管道,并构建了UniREdit-Data-100K,一个大规模合成数据集,具有高质量的推理注释。我们在此数据集上微调Bagel,并开发了UniREdit-Bagel,在域内和域外设置中均取得了显著改进。通过彻底评估开源和闭源图像编辑模型,我们揭示了它们在各个方面的优缺点。

英文摘要:

Recent advances in multi-modal generative models have driven substantial improvements in image editing. However, current generative models still struggle with handling diverse and complex image editing tasks that require implicit reasoning, underscoring the need for a comprehensive benchmark to systematically assess their performance across various reasoning scenarios. Existing benchmarks primarily focus on single-object attribute transformation in realistic scenarios, which, while effective, encounter two key challenges: (1) they largely overlook multi-object interactions as well as game-world scenarios that involve human-defined rules, which are common in real-life applications; (2) they only rely on textual references to evaluate the generated images, potentially leading to systematic misjudgments, especially in complex reasoning scenarios. To this end, this work proposes UniREditBench, a unified benchmark for reasoning-based image editing evaluation. It comprises 2,700 meticulously curated samples, covering both real- and game-world scenarios across 8 primary dimensions and 18 sub-dimensions. To improve evaluation reliability, we introduce multimodal dual-reference evaluation, providing both textual and ground-truth image references for each sample assessment. Furthermore, we design an automated multi-scenario data synthesis pipeline and construct UniREdit-Data-100K, a large-scale synthetic dataset with high-quality chain-of-thought (CoT) reasoning annotations. We fine-tune Bagel on this dataset and develop UniREdit-Bagel, demonstrating substantial improvements in both in-domain and out-of-distribution settings. Through thorough benchmarking of both open-source and closed-source image editing models, we reveal their strengths and weaknesses across various aspects.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑