The analytical description of charts is an exciting and important research area with many applications in academia and industry. Yet, this challenging task has received limited attention from the computational linguistics research community. This paper proposes \textsf{AutoChart}, a large dataset for the analytical description of charts, which aims to encourage more research into this important area. Specifically, we offer a novel framework that generates the charts and their analytical description automatically. We conducted extensive human and machine evaluations on the generated charts and descriptions and demonstrate that the generated texts are informative, coherent, and relevant to the corresponding charts.
Chart-to-Text: Generating Natural Language Descriptions for Charts by Adapting the Transformer Model
York University(约克大学)
信息可视化(如条形图和折线图)在探索数据和传达见解方面非常受欢迎。对某些人来说,解释和理解这种可视化可能具有挑战性,例如那些视力受损或视觉素养低的人。在这项工作中,我们引入了一个新的数据集,并提出了一个神经模型自动生成图表的自然语言摘要。生成的摘要提供了对图表的解释,并传达了在该图表中发现的关键见解。我们的神经模型是通过扩展数据到文本生成任务的最先进模型开发的,该模型利用了基于transformer的编码器-解码器架构。我们发现,我们的方法在内容选择指标上远远优于基础模型(55.42% vs. 8.49%),并生成了更多信息,简洁和连贯的摘要。
ChartFI: Benchmarking Faithfulness and Insightfulness of Chart Descriptions from Multimodal Large Language Models
School of Data Science, Fudan University(复旦大学数据科学学院);Zhengzhou Zhongke Institute of Integrated Circuit and System Application(郑州中凯集成电路与系统应用研究院);School of Computer Science, Fudan University(复旦大学计算机科学学院)
Do LVLMs Understand Charts? Analyzing and Correcting Factual Errors in Chart Captioning
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Columbia University(哥伦比亚大学);Salesforce AI Research(Salesforce AI研究院);DAMO Academy, Alibaba Group(阿里巴巴达摩院)