Large Multi-modality Models (LMMs) have made significant progress in visual understanding and generation, but they still face challenges in General Visual Editing, particularly in following complex instructions, preserving appearance consistency, and supporting flexible input formats. To study this gap, we introduce RISEBench, the first benchmark for evaluating Reasoning-Informed viSual Editing (RISE). RISEBench focuses on four key reasoning categories: Temporal, Causal, Spatial, and Logical Reasoning. We curate high-quality test cases for each category and propose an robust evaluation framework that assesses Instruction Reasoning, Appearance Consistency, and Visual Plausibility with both human judges and the LMM-as-a-judge approach. We conducted experiments evaluating nine prominent visual editing models, comprising both open-source and proprietary models. The evaluation results demonstrate that current models face significant challenges in reasoning-based editing tasks. Even the most powerful model evaluated, GPT-4o-Image, achieves an accuracy of merely 28.8%. RISEBench effectively highlights the limitations of contemporary editing models, provides valuable insights, and indicates potential future directions for the field of reasoning-aware visual editing. Our code and data have been released at https://github.com/PhoenixZ810/RISEBench.
The University of Hong Kong（香港大学）；JD Explore Academy（京东探索研究院）；Tsinghua University（清华大学）；The Hong Kong University of Science and Technology（香港科技大学）；The Chinese University of Hong Kong（香港中文大学）
Polyp-E: Benchmarking the Robustness of Deep Segmentation Models via Polyp Editing
School of Artificial Intelligence, Beijing University of Posts and Telecommunications（北京邮电大学人工智能学院）；The Fifth Medical Center, Chinese PLA General Hospital（中国人民解放军总医院第五医学中心）；Children’s Hospital of Zhejiang University School of Medicine（浙江大学医学院附属儿童医院）
Alibaba Group（阿里巴巴集团）；Zhejiang University（浙江大学）；Inst. of Comput. Tech., CAS（中国科学院计算技术研究所）
Recent studies have shown that higher accuracy on ImageNet usually leads to better robustness against different corruptions. Therefore, in this paper, instead of following the traditional research paradigm that investigates new out-of-distribution corruptions or perturbations deep models may encounter, we conduct model debugging in in-distribution data to explore which object attributes a model may be sensitive to. To achieve this goal, we create a toolkit for object editing with controls of backgrounds, sizes, positions, and directions, and create a rigorous benchmark named ImageNet-E(diting)…
Shanghai Jiao Tong University（上海交通大学）；Southeast University（东南大学）；South China University of Technology（华南理工大学）；Microsoft Research Asia（微软亚洲研究院）；Fudan University（复旦大学）；East China Normal University（华东师范大学）
East China Normal University（华东师范大学）；Xiaohongshu Inc.（小红书）；KLATASDS, MOE, China（中国教育部统计与数据科学重点实验室）；The Chinese University of Hong Kong（香港中文大学）；Zhejiang University（浙江大学）；Fudan University（复旦大学）；University of Oxford（牛津大学）；Shanghai Jiao Tong University（上海交通大学）；University of Science and Technology of China（中国科学技术大学）；Nanjing University（南京大学）
Southeast University（东南大学）；Max Planck Institute for Informatics（马克斯·普朗克信息研究所）；Shanghai Jiao Tong University（上海交通大学）；StepFun；University of California, Berkeley（加州大学伯克利分校）；University of California, Merced（加州大学默塞德分校）
ByteMorph: Benchmarking Instruction-Guided Image Editing with Non-Rigid Motions
ByteDance Seed（字节跳动种子）；University of Southern California（南加州大学）；University of Tokyo（东京大学）；University of California Berkeley（加州大学伯克利分校）；Stanford University（斯坦福大学）；University of California Los Angeles（加州大学洛杉矶分校）
WEAVE: Unleashing and Benchmarking the In-context Interleaved Comprehension and Generation
National University of Singapore（新加坡国立大学）；Nanyang Technological University（南洋理工大学）；University of Maryland, College Park（马里兰大学学院公园分校）；Zhejiang University（浙江大学）
LMM4Edit: Benchmarking and Evaluating Multimodal Image Editing with LMMs
Institute of Image Communication and Network Engineering, Shanghai JiaoTong University（上海交通大学图像通信与网络工程研究所）；University of Electronic and Science Technology of China（电子科技大学）；Nanyang Technological University（南洋理工大学）
InEdit-Bench: Benchmarking Intermediate Logical Pathways for Intelligent Image Editing Models
State Key Laboratory of Optical Field Manipulation Science and Technology, Institute of Optics and Electronics, Chinese Academy of Sciences（光学场操控科学与技术国家重点实验室，光学电子研究所，中国科学院）；National Laboratory on Adaptive Optics（自适应光学国家实验室）；University of Chinese Academy of Sciences（中国科学院大学）
Benchmarking Unified Face Attack Detection via Hierarchical Prompt Tuning
State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS), Institute of Automation, Chinese Academy of Sciences (CASIA)（多模态人工智能系统国家重点实验室（MAIS），自动化研究所，中国科学院（CASIA））；Department of Computer Science, College of Computing, City University of Hong Kong（计算机科学系，计算学院，香港城市大学）；School of Computer Science and Engineering, Faculty of Innovation Engineering, Macau University of Science and Technology（计算机科学与工程学院，创新工程学院，澳门科学理工学院）；Department of Computer Science and Engineering, Michigan State University（计算机科学与工程系，密歇根州立大学）；School of Cyber Science and Technology, University of Science and Technology of China（网络科学与技术学院，中国科学技术大学）；Ant Group（蚂蚁集团）；Imperial College London（伦敦帝国理工学院）
PICABench: How Far Are We from Physically Realistic Image Editing?
Shanghai Jiao Tong University（上海交通大学）；Shanghai AI Laboratory（上海人工智能实验室）；CUHK MMLab（香港中文大学多媒体实验室）；Krea AI；Beihang University（北京航空航天大学）；Tongyi Lab（通义实验室）；USTC（中国科学技术大学）；The University of Hong Kong（香港大学）
MICON-Bench: Benchmarking and Enhancing Multi-Image Context Image Generation in Unified Multimodal Models
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University（多媒体可信感知与高效计算重点实验室，中国教育部，厦门大学）；Zhongguancun Academy, Beijing, China（中关村学院，北京，中国）
IF-Bench: Benchmarking and Enhancing MLLMs for Infrared Images with Generative Visual Prompting
MAIS, Institute of Automation（自动化研究所信息处理中心）；School of Artificial Intelligence, UCAS（中国科学院大学人工智能学院）；Research Center of Aerospace Information, Institute of Automation（自动化研究所航空信息研究中心）
