arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.23622cs.CVcs.AI

DLEBench: 评估基于指令的图像编辑模型在小规模物体编辑能力

DLEBench: Evaluating Small-scale Object Editing Ability for Instruction-based Image Editing Model

College of Computer Science(计算机科学学院);Artificial Intelligence(人工智能);Fudan University(复旦大学)

Shibo Hong, Boxian Ai, Jun Kuang, Wei Wang, FengJiao Chen, Zhongyuan Peng, Chenhao Huang, Yixin Cao

AI总结:

本文提出DLEBench,首个专门评估基于指令的图像编辑模型在小规模物体编辑能力的基准,通过1889个样本覆盖复杂场景,揭示了现有模型在小物体编辑上的性能差距,强调了专用基准的重要性。

摘要:

在基于指令的图像编辑模型(IIEMs)领域已取得显著进展。然而,尽管这些模型在当前基准上表现出对指令的合理遵循和强大的推理能力,但它们在编辑小物体方面的能力仍缺乏深入探索,尽管这对精确局部编辑和生成图像中细节的细化至关重要。本文介绍了DeepLookEditBench(DLEBench),首个专门评估IIEMs在编辑小规模物体能力的基准。具体而言,我们构建了一个包含七个指令类型的挑战性测试平台,共1889个样本。在这些样本中,目标物体仅占图像面积的1%-10%,涵盖了部分遮挡和多物体编辑等复杂场景。为确保对本基准的稳健评估,我们提出了一种评估协议,包含细化的评分标准,以最小化在“指令遵循”和“视觉一致性”两个标准中的主观性和歧义性。该协议还引入了双模式评估框架(工具驱动模式和Oracle引导模式),以解决DLEBench中LMM-as-a-Judge与人类判断之间的不一致问题。在10个IIEMs上的实证结果揭示了小规模物体编辑上的显著性能差距,突显了专用基准在推动该能力发展方面的重要性。

英文摘要:

Significant progress has been made in the field of Instruction-based Image Editing Models (IIEMs). However, while these models demonstrate plausible adherence to instructions and strong reasoning ability on current benchmarks, their ability to edit small objects remains underexplored, despite its importance for precise local editing and refining details in both real and generated images. In this paper, we introduce DeepLookEditBench (DLEBench), the first benchmark dedicated to assessing the abilities of IIEMs in editing small-scale objects. Specifically, we construct a challenging testbed comprising 1889 samples across seven instruction types. In these samples, target objects occupy only 1%-10% of the image area, covering complex scenarios such as partial occlusion and multi-object editing. To ensure robust evaluation on this benchmark, we propose an evaluation protocol with refined score rubrics to minimize subjectivity and ambiguity in two criteria: Instruction Following and Visual Consistency. This protocol also introduces a dual-mode evaluation framework (Tool-driven and Oracle-guided Modes) addressing the misalignment between LMM-as-a-Judge and human judgements on DLEBench. Empirical results on 10 IIEMs reveal significant performance gaps in small-scale object editing, highlighting the need for specialized benchmarks to advance this ability.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑