arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2605.14842cs.CV

编辑推荐:通过原子实体分析评估图像编辑中的抽象意图

Editor's Choice: Evaluating Abstract Intent in Image Editing through Atomic Entity Analysis

Technion – Israel Institute of Technology(技术ion – 以色列理工学院);Google Research(谷歌研究)

Mor Ventura, Roy Hirsch, Yonatan Bitton, Regev Cohen, Roi Reichart

AI总结:

本文提出通过原子实体分析评估图像编辑中抽象意图的方法,引入Entity-Rubrics框架并构建AbstractEdit基准,揭示现有模型在平衡意图与保留之间的挑战,强调结合先进LLM和迭代思维的重要性。

摘要:

人类通过抽象概念如“情绪”自然交流,但当前图像编辑基准主要关注显式指令,抽象指令研究不足。本文首先定义并分类抽象图像编辑,引入Entity-Rubrics框架将抽象编辑分解为实体级评估,实现与人类判断的强相关性。同时贡献AbstractEdit基准,评估11个模型发现标准架构难以平衡意图与保留,常导致过度或欠编辑。分析表明,驱动有意义改进需整合先进LLM文本编码器和迭代思维。未来,基于实体的范式可推广至奖励模型,帮助模型正确解读抽象交流或突出测试时的失败。最终,本文旨在推动无缝多模态交互,弥合机器执行与人类自然交流之间的差距。

英文摘要:

Humans naturally communicate through abstract concepts like "mood". However, current image editing benchmarks focus primarily on explicit, literal commands, leaving abstract instructions largely underexplored. In this work, we first formalize the definition and taxonomy of abstract image editing. To measure instruction-following in this challenging domain, we introduce Entity-Rubrics, a framework that breaks down abstract edits into individual, entity-level assessments and achieves strong correlation with human judgment. Alongside this framework, we contribute AbstractEdit, the first benchmark dedicated to abstract image editing across diverse real-world scenes. Evaluating 11 leading models on this dataset reveals a fundamental challenge: standard architectures struggle to balance intent and preservation, commonly defaulting to under-editing or over-editing. Our analysis demonstrates that driving meaningful improvements relies heavily on integrating advanced LLM text encoders and iterative thinking. Looking forward, our entity-based paradigm can generalize beyond assessment to serve as a reward model, enable models to correctly interpret abstract communication, or highlight specific failures in test-time critique loops. Ultimately, we hope this work serves as a stepping stone toward seamless multimodal interaction, closing the gap between rigid machine execution and the natural, open-ended way humans communicate.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑