arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2604.26250cs.CV

超越捷径:通过定性推理缓解冻结VLM中的视觉错觉

Beyond Shortcuts: Mitigating Visual Illusions in Frozen VLMs via Qualitative Reasoning

Institute of Artificial Intelligence, Hefei Comprehensive National Science Center(人工智能研究院,合肥国家科学中心);Anhui Polytechnic University(安徽理工大学);Hefei University of Technology(合肥工业大学);Anhui University(安徽大学);IGS, Imperial College London(帝国理工学院伦敦分校)

Hao Guo, Fei Wang, Junjie Chen, Yiqi Nie, Jiaqi Zhao, Qiankun Li, Subin Huang

AI总结:

本文提出SQI框架,通过定性约束提升冻结VLM的视觉 grounding,解决视觉错觉问题,实验显示在DataCV 2026挑战中表现优异,提升准确率并提供更好的可解释性。

摘要:

尽管视觉语言模型(VLMs)在通用视觉任务中表现出色,但其感知鲁棒性在面对光学错觉时却异常脆弱。这些失败通常归因于捷径启发式,即模型优先考虑语言先验和记忆原型而非直接视觉证据。本文提出结构化定性推理(SQI),一种无需训练的数据驱动框架,旨在增强冻结VLM的视觉 grounding。SQI通过三个系统模块解决感知异常:(1)公理约束注入,抑制错误度量估计和定量幻觉;(2)分层场景分解,将目标视觉流形与复杂背景干扰分离;(3)反事实自我验证,通过对抗性推理缓解确认偏见。通过在推理时协调这些定性约束,SQI有效对齐高层语言推理与低层视觉感知。我们的框架在DataCV 2026挑战(任务I:经典错觉理解)中排名第二。实验结果表明,SQI不仅显著提高了不同错觉类别的准确性,还提供了更优越的诊断可解释性,而无需任何模型微调。我们的成功凸显了结构化定性 grounding 作为开发下一代抗错觉视觉语言系统稳健范式的潜力。

英文摘要:

While Vision-Language Models (VLMs) have achieved state-of-the-art performance in general visual tasks, their perceptual robustness remains remarkably brittle when confronted with optical illusions. These failures are often attributed to shortcut heuristics, where models prioritize linguistic priors and memorized prototypes over direct visual evidence. In this work, we propose Structured Qualitative Inference (SQI), a training-free, data-centric framework designed to fortify visual grounding in frozen VLMs. SQI addresses perceptual anomalies through three systematic modules: (1) Axiomatic Constraint Injection, which suppresses erroneous metric estimations and quantitative hallucinations; (2) Hierarchical Scene Decomposition, which decouples target visual manifolds from complex background distractors; and (3) Counterfactual Self-Verification, an adversarial reasoning step that mitigates confirmation bias. By orchestrating these qualitative constraints at inference time, SQI effectively aligns high-level linguistic reasoning with low-level visual perception. Our framework was evaluated on the DataCV 2026 Challenge (Task I: Classic Illusion Understanding), where it ranked 2nd place overall. Experimental results demonstrate that SQI not only significantly enhances accuracy across diverse illusion categories but also provides superior diagnostic interpretability without any model fine-tuning. Our success underscores the potential of structured qualitative grounding as a robust paradigm for developing next-generation, illusion-resistant vision-language systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑