ChartE$^{3}$: 一个全面的端到端图表编辑基准
ChartE$^{3}$: A Comprehensive Benchmark for End-to-End Chart Editing
AI总结：
ChartE$^{3}$提出一个端到端图表编辑基准，通过多模态大语言模型评估，揭示了现有技术在全局编辑任务上的性能差距。
摘要：
图表是结构化数据分析的基本可视化格式。根据用户意图实现端到端的图表编辑具有重要的实际价值，但仍然具有挑战性，因为需要精细的控制和全局结构的一致性。大多数现有方法采用管道式设计，其中自然语言或代码作为中间表示，限制了它们执行复杂编辑的能力。我们引入了ChartE$^{3}$，一个端到端的图表编辑基准，直接评估模型而不依赖中间的自然语言程序或代码级监督。ChartE$^{3}$专注于两个互补的编辑维度：局部编辑，涉及字体或颜色等细粒度外观变化，以及全局编辑，需要整体的数据中心化转换，包括数据过滤和趋势线添加。ChartE$^{3}$包含超过1200个高质量样本，通过精心设计的数据管道和人工校验构建。每个样本都提供图表图像、其底层代码和多模态编辑指令的三元组，使评估可以从客观和主观两个方面进行。对最先进的多模态大语言模型进行广泛基准测试，揭示了显著的性能差距，特别是在全局编辑任务上，突显了当前端到端图表编辑能力的关键限制。
英文摘要：
Charts are a fundamental visualization format for structured data analysis. Enabling end-to-end chart editing according to user intent is of great practical value, yet remains challenging due to the need for both fine-grained control and global structural consistency. Most existing approaches adopt pipeline-based designs, where natural language or code serves as an intermediate representation, limiting their ability to faithfully execute complex edits. We introduce ChartE$^{3}$, an End-to-End Chart Editing benchmark that directly evaluates models without relying on intermediate natural language programs or code-level supervision. ChartE$^{3}$ focuses on two complementary editing dimensions: local editing, which involves fine-grained appearance changes such as font or color adjustments, and global editing, which requires holistic, data-centric transformations including data filtering and trend line addition. ChartE$^{3}$ contains over 1,200 high-quality samples constructed via a well-designed data pipeline with human curation. Each sample is provided as a triplet of a chart image, its underlying code, and a multimodal editing instruction, enabling evaluation from both objective and subjective perspectives. Extensive benchmarking of state-of-the-art multimodal large language models reveals substantial performance gaps, particularly on global editing tasks, highlighting critical limitations in current end-to-end chart editing capabilities.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
