WiseEdit: 图像编辑的认知与创造力导向基准测试
WiseEdit: Benchmarking Cognition- and Creativity-Informed Image Editing
AI总结：
WiseEdit通过分解图像编辑为意识、解释和想象三个步骤，结合三种知识类型，全面评估图像编辑的认知与创造力能力。
摘要：
最近的图像编辑模型具备了高级的智能能力，能够促进具有认知和创造力导向的图像编辑。然而，现有的基准测试提供评估范围过于狭窄，无法全面评估这些高级能力。为了解决这个问题，我们引入了WiseEdit，一个知识密集型的基准测试，用于全面评估认知和创造力导向的图像编辑，具有深入的任务深度和广泛的知识广度。借鉴人类认知创造的类比，WiseEdit将图像编辑分解为三个连续的步骤，即意识、解释和想象，每个步骤对应一个对模型在特定步骤上完成挑战的任务。它还包含复杂任务，其中三个步骤都无法轻易完成。此外，WiseEdit包含三种基本类型的知识：陈述性知识、程序性知识和元认知知识。最终，WiseEdit包含1220个测试用例，客观地揭示了当前最先进的图像编辑模型在基于知识的认知推理和创造性组合能力上的局限性。该基准测试、评估代码以及每个模型生成的图像将在不久后公开。项目页面：https://qnancy.github.io/wiseedit_project_page/。
英文摘要：
Recent image editing models boast next-level intelligent capabilities, facilitating cognition- and creativity-informed image editing. Yet, existing benchmarks provide too narrow a scope for evaluation, failing to holistically assess these advanced abilities. To address this, we introduce WiseEdit, a knowledge-intensive benchmark for comprehensive evaluation of cognition- and creativity-informed image editing, featuring deep task depth and broad knowledge breadth. Drawing an analogy to human cognitive creation, WiseEdit decomposes image editing into three cascaded steps, i.e., Awareness, Interpretation, and Imagination, each corresponding to a task that poses a challenge for models to complete at the specific step. It also encompasses complex tasks, where none of the three steps can be finished easily. Furthermore, WiseEdit incorporates three fundamental types of knowledge: Declarative, Procedural, and Metacognitive knowledge. Ultimately, WiseEdit comprises 1,220 test cases, objectively revealing the limitations of SoTA image editing models in knowledge-based cognitive reasoning and creative composition capabilities. The benchmark, evaluation code, and the generated images of each model will be made publicly available soon. Project Page: https://qnancy.github.io/wiseedit_project_page/.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
