arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.17291cs.HCcs.AIcs.CLcs.CV
收藏

LLM在检测误导性可视化方面表现有多好(或多坏)?

How Good (Or Bad) Are LLMs at Detecting Misleading Visualizations?

Hong Kong University of Science and Technology(香港科技大学)

Leo Yu-Ho Lo, Huamin Qu

AI总结:

本研究探讨了多模态LLM在检测误导性图表中的能力,通过设计九种提示测试四种模型识别21种图表问题,发现多模态LLM具备较强的图表理解和批判性思维能力,能有效应对误导性可视化问题。

摘要:

在本研究中,我们探讨了日益严重的误导性图表问题,这是一个破坏信息传播完整性的普遍问题。误导性图表会扭曲观看者对数据的感知,导致基于错误信息的误解和决策。开发有效的误导性图表自动检测方法是一个迫切的研究领域。多模态大型语言模型(LLM)的最新进展为应对这一挑战引入了有前景的方向。我们探索了这些模型在分析复杂图表方面的能力,并评估了不同提示策略对模型分析的影响。我们利用先前研究从互联网收集的误导性图表数据集,设计了从简单到复杂的九个不同提示,以测试四种不同的多模态LLM检测超过21种不同图表问题的能力。通过三项实验——从初步探索到详细分析——我们逐步深入了解了如何有效地提示LLM识别误导性图表,并制定了策略以应对在将检测范围从最初的五个问题扩展到最终实验的21个问题时所遇到的可扩展性挑战。我们的发现表明,多模态LLM在数据解释方面具备强大的图表理解能力和批判性思维。通过支持批判性思维和增强可视化素养,采用多模态LLM来对抗误导性信息具有巨大潜力。本研究证明了LLM在解决误导性图表这一紧迫问题上的适用性。

英文摘要:

In this study, we address the growing issue of misleading charts, a prevalent problem that undermines the integrity of information dissemination. Misleading charts can distort the viewer's perception of data, leading to misinterpretations and decisions based on false information. The development of effective automatic detection methods for misleading charts is an urgent field of research. The recent advancement of multimodal Large Language Models (LLMs) has introduced a promising direction for addressing this challenge. We explored the capabilities of these models in analyzing complex charts and assessing the impact of different prompting strategies on the models' analyses. We utilized a dataset of misleading charts collected from the internet by prior research and crafted nine distinct prompts, ranging from simple to complex, to test the ability of four different multimodal LLMs in detecting over 21 different chart issues. Through three experiments--from initial exploration to detailed analysis--we progressively gained insights into how to effectively prompt LLMs to identify misleading charts and developed strategies to address the scalability challenges encountered as we expanded our detection range from the initial five issues to 21 issues in the final experiment. Our findings reveal that multimodal LLMs possess a strong capability for chart comprehension and critical thinking in data interpretation. There is significant potential in employing multimodal LLMs to counter misleading information by supporting critical thinking and enhancing visualization literacy. This study demonstrates the applicability of LLMs in addressing the pressing concern of misleading charts.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑