Generative models, such as diffusion and autoregressive approaches, have demonstrated impressive capabilities in editing natural images. However, applying these tools to scientific charts rests on a flawed assumption: a chart is not merely an arrangement of pixels but a visual representation of structured data governed by a graphical grammar. Consequently, chart editing is not a pixel-manipulation task but a structured transformation problem. To address this fundamental mismatch, we introduce \textit{FigEdit}, a large-scale benchmark for scientific figure editing comprising over 30,000 samples. Grounded in real-world data, our benchmark is distinguished by its diversity, covering 10 distinct chart types and a rich vocabulary of complex editing instructions. The benchmark is organized into five distinct and progressively challenging tasks: single edits, multi edits, conversational edits, visual-guidance-based edits, and style transfer. Our evaluation of a range of state-of-the-art models on this benchmark reveals their poor performance on scientific figures, as they consistently fail to handle the underlying structured transformations required for valid edits. Furthermore, our analysis indicates that traditional evaluation metrics (e.g., SSIM, PSNR) have limitations in capturing the semantic correctness of chart edits. Our benchmark demonstrates the profound limitations of pixel-level manipulation and provides a robust foundation for developing and evaluating future structure-aware models. By releasing \textit{FigEdit} (https://github.com/adobe-research/figure-editing), we aim to enable systematic progress in structure-aware figure editing, provide a common ground for fair comparison, and encourage future research on models that understand both the visual and semantic layers of scientific charts.
Semantic-Structural Alignment for Generative Pictorial Charts
Visual Computing Research Center (VCC), College of Computer Science and Software Engineering (CSSE) Shenzhen University China(视觉计算研究中心(VCC)、计算机科学与软件工程学院(CSSE)深圳大学中国)
Factuality Matters: When Image Generation and Editing Meet Structured Visuals
CUHK MMLab(香港大学多模态实验室);Beihang University(北京航空航天大学);Krea AI(Krea人工智能);Shanghai Jiao Tong University(上海交通大学);Shanghai AI Lab(上海人工智能实验室);Hugging Face;National University of Singapore(新加坡国立大学);ByteDance(字节跳动);The University of Hong Kong(香港大学)
ChartSync: A Benchmark for Visuo-Logical Cascading Chart Editing
Jianghan University(江汉大学);HiThink Research(海思睿研);University of Science and Technology of China(中国科学技术大学);Southeast University(东南大学);Zhejiang University(浙江大学)
InEdit-Bench: Benchmarking Intermediate Logical Pathways for Intelligent Image Editing Models
State Key Laboratory of Optical Field Manipulation Science and Technology, Institute of Optics and Electronics, Chinese Academy of Sciences(光学场操控科学与技术国家重点实验室,光学电子研究所,中国科学院);National Laboratory on Adaptive Optics(自适应光学国家实验室);University of Chinese Academy of Sciences(中国科学院大学)
ClimateViz: A Benchmark for Statistical Reasoning and Fact Verification on Scientific Charts
University of Oxford(牛津大学);Qilu University of Technology(Shandong Academy of Sciences)(齐鲁工业大学(山东科学院));Hong Kong University of Science and Technology(香港科学大学);Hong Kong University of Science and Technology (Guangzhou)(香港科学大学(广州))
PlotPick: AI-powered batch extraction of numerical data from scientific figures
Copenhagen Research Centre for Biological and Precision Psychiatry(哥本哈根生物与精准精神病学研究中心);Mental Health Centre Copenhagen(哥本哈根心理健康中心);Copenhagen University Hospital(哥本哈根大学医院)
Diagram-MMU: A Multi-Modal Benchmark for Scientific Diagrams
Nanjing University of Science and Technology(南京理工大学);Baidu Inc(百度公司);AIML, Adelaide University(阿德莱德大学AIML);SUTD(新加坡科技设计大学);Southeast University(东南大学);East China Normal University(华东师范大学);University of Oxford(牛津大学)
SciVQR: A Multidisciplinary Multimodal Benchmark for Advanced Scientific Reasoning Evaluation
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);OPPO AI Center(OPPO AI中心)
InternVL-U: Democratizing Unified Multimodal Models for Understanding, Reasoning, Generation and Editing
Shanghai AI Laboratory(上海人工智能实验室);Fudan University(复旦大学);University of Science and Technology of China(中国科学技术大学);Shanghai Jiao Tong University(上海交通大学);South China University of Technology(华南理工大学);Nanjing University(南京大学);Xiamen University(厦门大学);CUHK MMLab(香港中文大学MMLab)
The Chinese University of Hong Kong Shanghai AI Laboratory(香港中文大学上海人工智能实验室);Shanghai AI Laboratory(上海人工智能实验室);Shanghai Jiao Tong University(上海交通大学);Shanghai Innovation Institute(上海创新研究院)
SciMMIR: Benchmarking Scientific Multi-modal Information Retrieval
Multimodal Art Projection Research Community(多模态艺术投影研究共同体);University of Manchester(曼彻斯特大学);University of Waterloo(滑铁卢大学);Hong Kong University of Science and Technology(香港科技大学);Durham University(杜伦大学)