arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2510.18619cs.AI

通过分层搜索与自验证的视觉注意力推理

Visual Attention Reasoning via Hierarchical Search and Self-Verification

Wei Cai, Jian Zhao, Yuchen Yuan, Tianle Zhang, Ming Zhu, Haichuan Tang, Xuelong Li

AI总结:

本文提出通过分层搜索与自验证的视觉注意力推理框架,有效提升多模态大语言模型的视觉定位和推理能力,显著降低幻觉发生率。

摘要:

多模态大语言模型(MLLMs)由于依赖脆弱的线性推理和弱视觉定位而经常产生幻觉。我们提出视觉注意力推理(VAR),一种强化学习框架,将推理重新表述为具有自验证的分层搜索。VAR通过生成显式的边界框来强制可追溯的证据定位,这些边界框由结合几何精度和语义充分性的新型奖励函数引导。此外,它用一种能够回溯纠正逻辑错误的树搜索策略取代线性思维链。理论分析验证了该框架的可靠性,广泛实验表明,VAR在复杂幻觉和安全基准上显著优于最先进的方法。

英文摘要:

Multimodal Large Language Models (MLLMs) frequently hallucinate due to their reliance on fragile, linear reasoning and weak visual grounding. We propose Visual Attention Reasoning (VAR), a reinforcement learning framework that reformulates reasoning as a hierarchical search with self-verification. VAR enforces traceable evidence grounding by generating explicit bounding boxes, guided by a novel reward function combining geometric precision and semantic sufficiency. Furthermore, it replaces linear Chain-of-Thought with a tree-search policy capable of backtracking to correct logical errors. Theoretical analysis validates the framework's reliability, and extensive experiments demonstrate that VAR significantly outperforms state-of-the-art methods on complex hallucination and safety benchmarks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑