arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2603.28583cs.CVcs.AIcs.MM

穿越幻象:一种双路径代理框架用于鲁棒的误导图表问答

Navigating the Mirage: A Dual-Path Agentic Framework for Robust Misleading Chart Question Answering

The Hong Kong University of Science and Technology(香港科技大学)

Yanjie Zhang, Yafei Li, Rui Sheng, Zixin Chen, Yanna Lin, Huamin Qu, Lei Chen, Yushi Sun

AI总结:

本文提出ChartCynics双路径框架,通过分离感知与验证,利用诊断视觉路径和OCR驱动数据路径解决图表误导问题,提升模型鲁棒性。

摘要:

尽管视觉语言模型(VLMs)取得成功,但误导图表仍是重大挑战,因其具有欺骗性视觉结构和扭曲的数据表示。我们提出了ChartCynics,一种代理双路径框架,通过“怀疑”推理范式揭示视觉欺骗。与整体模型不同,ChartCynics将感知与验证分离:诊断视觉路径通过战略性ROI裁剪捕捉结构异常(例如翻转的轴),而OCR驱动的数据路径确保数值基础。为解决跨模态冲突,我们引入了通过两阶段协议优化的代理总结器:Oracle引导的SFT用于推理蒸馏和Deception-aware GRPO用于对抗对齐。该流程有效惩罚视觉陷阱并强制逻辑一致性。在两个基准上的评估显示,ChartCynics在准确率上达到74.43%和64.55%,比Qwen3-VL-8B基础模型提升了约29%,优于最先进的专有模型。我们的结果表明,专门的代理工作流可以赋予较小的开源模型更强的鲁棒性,为可信图表解释建立新基础。

英文摘要:

Despite the success of Vision-Language Models (VLMs), misleading charts remain a significant challenge due to their deceptive visual structures and distorted data representations. We present ChartCynics, an agentic dual-path framework designed to unmask visual deception via a "skeptical" reasoning paradigm. Unlike holistic models, ChartCynics decouples perception from verification: a Diagnostic Vision Path captures structural anomalies (e.g., inverted axes) through strategic ROI cropping, while an OCR-Driven Data Path ensures numerical grounding. To resolve cross-modal conflicts, we introduce an Agentic Summarizer optimized via a two-stage protocol: Oracle-Informed SFT for reasoning distillation and Deception-Aware GRPO for adversarial alignment. This pipeline effectively penalizes visual traps and enforces logical consistency. Evaluations on two benchmarks show that ChartCynics achieves 74.43% and 64.55% accuracy, providing an absolute performance boost of ~29% over the Qwen3-VL-8B backbone, outperforming state-of-the-art proprietary models. Our results demonstrate that specialized agentic workflows can grant smaller open-source models superior robustness, establishing a new foundation for trustworthy chart interpretation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑