HallusionBench:大型视觉语言模型中纠缠的语言幻觉与视觉错觉的高级诊断套件
HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Models
AI总结:
本文提出HallusionBench基准,通过346张图像和1129个问题评估大型视觉语言模型的图像上下文推理能力,发现即使最先进的GPT-4V准确率也仅31.42%,揭示了语言幻觉和视觉错觉等关键失败模式。
摘要:
我们介绍了HallusionBench,一个为评估图像上下文推理而设计的综合基准。该基准通过强调对视觉数据的细致理解和解释,对GPT-4V(Vision)、Gemini Pro Vision、Claude 3和LLaVA-1.5等先进的大型视觉语言模型(LVLMs)提出了重大挑战。该基准包含346张图像和1129个问题,均由人类专家精心制作。我们为这些视觉问题引入了一种新颖的结构,旨在建立对照组。这种结构使我们能够对模型的响应倾向、逻辑一致性和各种失败模式进行定量分析。我们在HallusionBench上对15个不同模型进行了评估,结果显示最先进的GPT-4V仅达到31.42%的问题对准确率。值得注意的是,所有其他评估模型的准确率均低于16%。此外,我们的分析不仅突出了观察到的失败模式(包括语言幻觉和视觉错觉),还加深了对这些缺陷的理解。我们在HallusionBench中的综合案例研究揭示了LVLMs中幻觉和错觉的挑战。基于这些见解,我们提出了未来改进的潜在路径。该基准和代码库可在https://github.com/tianyi-lab/HallusionBench获取。
英文摘要:
We introduce HallusionBench, a comprehensive benchmark designed for the evaluation of image-context reasoning. This benchmark presents significant challenges to advanced large visual-language models (LVLMs), such as GPT-4V(Vision), Gemini Pro Vision, Claude 3, and LLaVA-1.5, by emphasizing nuanced understanding and interpretation of visual data. The benchmark comprises 346 images paired with 1129 questions, all meticulously crafted by human experts. We introduce a novel structure for these visual questions designed to establish control groups. This structure enables us to conduct a quantitative analysis of the models' response tendencies, logical consistency, and various failure modes. In our evaluation on HallusionBench, we benchmarked 15 different models, highlighting a 31.42% question-pair accuracy achieved by the state-of-the-art GPT-4V. Notably, all other evaluated models achieve accuracy below 16%. Moreover, our analysis not only highlights the observed failure modes, including language hallucination and visual illusion, but also deepens an understanding of these pitfalls. Our comprehensive case studies within HallusionBench shed light on the challenges of hallucination and illusion in LVLMs. Based on these insights, we suggest potential pathways for their future improvement. The benchmark and codebase can be accessed at https://github.com/tianyi-lab/HallusionBench.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。