arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.20291cs.CV
收藏

图表去渲染、推理与修复:基于视觉-语言模型

De-rendering, Reasoning, and Repairing Charts with Vision-Language Models

Universidad Torcuato Di Tella(托克托迪特拉大学);Consejo Nacional de Investigaciones Científicas y Técnicas(国家科学与技术研究理事会);Facultad de Ciencias Exactas y Naturales Universidad de Buenos Aires(布宜诺斯艾利斯大学科学与自然学院)

Valentin Bonas, Martin Sinnona, Viviana Siless, Emmanuel Iarussi

AI总结:

本文提出了一种结合图表去渲染、自动分析和迭代改进的框架,利用视觉-语言模型提供基于原则的可视化设计反馈,提升可视化质量和素养。

摘要:

数据可视化在科学交流、新闻报道和日常决策中至关重要,但它们经常容易出错,可能导致解释扭曲或误导观众。基于规则的可视化检查工具可以标记违规行为,但它们忽略了上下文,并不建议有意义的设计更改。直接向通用大语言模型查询可视化质量不可靠:由于缺乏遵循可视化设计原则的训练,它们经常产生不一致或错误的反馈。在本工作中,我们介绍了一个框架,结合图表去渲染、自动分析和迭代改进,以提供可操作、可解释的可视化设计反馈。我们的系统从图像中重建图表的结构,利用视觉-语言推理识别设计缺陷,并提出受可视化研究中已确立原则支持的具体修改。用户可以有选择地应用这些改进并重新渲染更新的图表,创建一个反馈循环,促进更高质量的可视化和可视化素养的发展。在对来自Chart2Code基准的1000张图表的评估中,系统生成了10,452条设计建议,这些建议聚类为10个清晰的类别(例如,轴格式、颜色可访问性、图例一致性)。这些结果突显了基于LLM的推荐系统在提供结构化、基于原则的可视化设计反馈方面的潜力,为更智能和可访问的作者工具打开了大门。

英文摘要:

Data visualizations are central to scientific communication, journalism, and everyday decision-making, yet they are frequently prone to errors that can distort interpretation or mislead audiences. Rule-based visualization linters can flag violations, but they miss context and do not suggest meaningful design changes. Directly querying general-purpose LLMs about visualization quality is unreliable: lacking training to follow visualization design principles, they often produce inconsistent or incorrect feedback. In this work, we introduce a framework that combines chart de-rendering, automated analysis, and iterative improvement to deliver actionable, interpretable feedback on visualization design. Our system reconstructs the structure of a chart from an image, identifies design flaws using vision-language reasoning, and proposes concrete modifications supported by established principles in visualization research. Users can selectively apply these improvements and re-render updated figures, creating a feedback loop that promotes both higher-quality visualizations and the development of visualization literacy. In our evaluation on 1,000 charts from the Chart2Code benchmark, the system generated 10,452 design recommendations, which clustered into 10 coherent categories (e.g., axis formatting, color accessibility, legend consistency). These results highlight the promise of LLM-driven recommendation systems for delivering structured, principle-based feedback on visualization design, opening the door to more intelligent and accessible authoring tools.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑