arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2607.07507cs.CVcs.AI

HIVE:理解视觉语言模型中的幻觉后推理

HIVE: Understanding Post-Hallucination Reasoning in Vision Language Models

Purdue University(普渡大学);Rutgers University(罗格斯大学);Meta AI;Kent State University(肯特州立大学);Imperial College London(伦敦帝国学院)

Feng He, Zhenting Wang, Qifan Wang, Qiang Guan, Dongfang Liu, Ruixiang Tang, Qiankun Li

AI总结:

研究视觉语言模型中幻觉后推理阶段,引入HIVE评估基础设施,通过九个任务和九个模型观察到模态依赖模式,发现幻觉线索能拓宽语义覆盖并重塑推理动态,强调理解此阶段对提升多模态推理系统可靠性和可解释性的重要性。

摘要:

视觉语言模型中的幻觉通常被视为语义错误,但它们往往源于部分或模糊的视觉证据。先前工作主要集中在生成时检测或抑制幻觉,后续推理阶段基本未被探索。本文研究幻觉后推理(PHR)阶段,即幻觉语义进入模型推理上下文并影响下游预测的阶段。为此引入HIVE评估基础设施,能对真实和幻觉字幕进行可控比较。通过九个任务和九个模型观察到结构化的模态依赖模式,幻觉字幕常提高视觉语言任务准确率,文本任务效果有限或不稳定。进一步分析表明幻觉线索拓宽语义覆盖并重塑推理动态,同时保持稳定推理。这些发现凸显幻觉语义进入模型推理上下文后可能影响下游推理,理解此阶段对提高多模态推理系统可靠性和可解释性很重要。

英文摘要:

Hallucinations in vision language models (VLMs) are commonly treated as semantic errors, yet they often arise from partial or ambiguous visual evidence. Prior work mainly focuses on detecting or suppressing hallucinations at generation time, leaving the subsequent reasoning stage largely unexplored. In this work, we study Post Hallucination Reasoning (PHR), the stage in which hallucinated semantics enter the model's inference context and influence downstream predictions. To systematically investigate PHR, we introduce HIVE, Hallucination Inference and Verification Engine, an evaluation infrastructure that enables controlled comparisons between faithful and hallucinated captions. Across nine tasks and nine models, we observe structured modality dependent patterns: hallucinated captions often improve accuracy on vision language tasks, while text only tasks exhibit limited or unstable effects. Further analyses show that hallucinated cues broaden semantic coverage and reshape reasoning dynamics while preserving stable inference. These findings highlight that hallucinated semantics may influence downstream reasoning once they enter the model's inference context. Understanding this post hallucination stage is important for improving the reliability and interpretability of multimodal reasoning systems. Code is publicly available at https://github.com/hefengcs/HIVE.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑