Developing on-device image models requires considering practical user needs, task types and device resource constraints. However, existing benchmarks provide limited guidance on identifying capability gaps between on-device models and server-side models. We introduce MoI-Bench, a benchmark grounded in mobile user needs, comprising 64 subtasks and 1150 samples. It defines 16 operations, such as removal and replacement, and eight visual target categories covering content such as portraits and text. These form two orthogonal axes whose applicable combinations define specific tasks, such as removing facial makeup. To better guide model improvement, we further propose MoI-Eval, which introduces task-specific criteria covering instruction following, visual quality and detail preservation. We further construct sample-level evaluation questions and aggregate their scores into overall quality and capability profiles along the operation, target and criteria axes. We evaluate representative on-device and server-side models and measure mobile deployment costs. Results show that this decoupled Operation x Target design provides finer-grained guidance for improving compact models. For example, it highlights the need to prioritize specific capability gaps (e.g., text-replacement) over broad application-level goals (e.g., improving text editing). Unlike conventional benchmarks that rank models using a single score, we introduce a two-dimensional Quality-Deployability capability map to assess models for practical mobile use. The map shows that current on-device models can achieve efficient generation or editing but expanding their task coverage deserves greater attention than further improving deployment efficiency. Further progress requires improving editing quality, particularly identity preservation and text rendering, while broadening task coverage.
InEdit-Bench: Benchmarking Intermediate Logical Pathways for Intelligent Image Editing Models
State Key Laboratory of Optical Field Manipulation Science and Technology, Institute of Optics and Electronics, Chinese Academy of Sciences（光学场操控科学与技术国家重点实验室，光学电子研究所，中国科学院）；National Laboratory on Adaptive Optics（自适应光学国家实验室）；University of Chinese Academy of Sciences（中国科学院大学）
Southeast University（东南大学）；Max Planck Institute for Informatics（马克斯·普朗克信息研究所）；Shanghai Jiao Tong University（上海交通大学）；StepFun；University of California, Berkeley（加州大学伯克利分校）；University of California, Merced（加州大学默塞德分校）
East China Normal University（华东师范大学）；Xiaohongshu Inc.（小红书）；KLATASDS, MOE, China（中国教育部统计与数据科学重点实验室）；The Chinese University of Hong Kong（香港中文大学）；Zhejiang University（浙江大学）；Fudan University（复旦大学）；University of Oxford（牛津大学）；Shanghai Jiao Tong University（上海交通大学）；University of Science and Technology of China（中国科学技术大学）；Nanjing University（南京大学）
FED-Bench: A Cross-Granular Benchmark for Disentangled Evaluation of Facial Expression Editing
Xi’an Jiaotong University（西安交通大学）；Northwestern Polytechnical University（西北工业大学）；National University of Singapore（新加坡国立大学）；Fudan University（复旦大学）；Zhejiang Lab（之江实验室）
Beyond Coherence: Benchmarking Professional Editing-Technique Execution in Multi-Shot Audio-Video Generation
Shanghai Jiao Tong University（上海交通大学）；Alibaba Group（阿里巴巴集团）；Fudan University（复旦大学）；UT Austin（德克萨斯大学奥斯汀分校）；Institute of Software, Chinese Academy of Sciences（中国科学院软件研究所）
PICABench: How Far Are We from Physically Realistic Image Editing?
Shanghai Jiao Tong University（上海交通大学）；Shanghai AI Laboratory（上海人工智能实验室）；CUHK MMLab（香港中文大学多媒体实验室）；Krea AI；Beihang University（北京航空航天大学）；Tongyi Lab（通义实验室）；USTC（中国科学技术大学）；The University of Hong Kong（香港大学）
FiVE: A Fine-grained Video Editing Benchmark for Evaluating Emerging Diffusion and Rectified Flow Models
Harvard AI and Robotics Lab, Harvard University（哈佛人工智能与机器人实验室，哈佛大学）；Broad Institute（博德研究所）；Hong Kong Polytechnic University（香港理工大学）；School of Engineering and Applied Sciences, Harvard University（哈佛大学工程与应用科学学院）；City University of Hong Kong（香港城市大学）；Kempner Institute for the Study of Natural and Artificial Intelligence, Harvard University（自然与人工智能研究学院，哈佛大学）
IVEBench: Modern Benchmark Suite for Instruction-Guided Video Editing Assessment
Zhejiang University（浙江大学）；Tencent Youtu Lab（腾讯优图实验室）；Shanghai Jiao Tong University（上海交通大学）；University of Auckland（奥克兰大学）；National University of Singapore（新加坡国立大学）
Taming I2V models for Image HOI Editing: A Cognitive Benchmark and Agentic Self-Correcting Framework
Wangxuan Institute of Computer Technology, Peking University, Beijing, China（王轩计算机技术研究所，北京大学，北京，中国）；National Institute of Health Data Science, Peking University, Beijing, China（国家健康数据科学研究院，北京大学，北京，中国）
