arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2610.12517cs.CV

TerraAgent:面向长上下文遥感视觉问答的基于演示的多智能体推理

TerraAgent: Demonstration-Grounded Multi-Agent Reasoning for Long-Context Remote Sensing Visual Question Answering

Yunnan University of Finance and Economics(云南财经大学)

Jingwen Huang, Yiming Fang, Hanxiao Wu, Boyuan He, Keyi Luo

AI总结:

AVA是一种无需训练的多模块框架,封装冻结的RS MLLM,通过演示检索、子问题路由、证据审核等模块,在多个遥感视觉问答数据集上提升准确率、降低先验依赖与幻觉率。

摘要:

遥感视觉问答(RS-VQA)要求答案真正依赖图像证据,但当前遥感多模态大语言模型(RS MLLM)的评估主要依赖准确率,无法判断正确答案是否未使用图像生成。该设置带来三大挑战:跨不同地面采样距离(GSD)、传感器和城市纹理检索的演示可能匹配度差;真实查询常涉及多尺度瓦片、多时相帧和检索知识构成的长视觉上下文,证据会被稀释且错误会通过多步推理传播;标准指标无法检测仅依赖先验知识的回答。本文提出AVA,一种无需训练的框架,将冻结的RS MLLM封装为三个模块:GDR执行按GSD分桶、基于场景图的演示检索,过滤答案无图像支持的演示;MACE将每个查询分解为证据类型的子问题有向无环图,将子问题路由至合适的感知工具,并在共享证据账本中记录经验证的来源,同时限制重复感知;CVA通过对引用证据的反事实扰动(包括消融和交换)审核最终答案,计算视觉依赖分数以进行置信度校准和证据强制重查询。在RSVQA-LR/HR、VRSBench和LHRS-Bench数据集上,AVA较最强同设置基线平均准确率提升最高达2.40个百分点,视觉依赖分数从0.28提升至0.49,仅依赖先验知识的回答率从46.2%降至21.7%,幻觉率从17.1%降至9.8%,其计算成本为单个骨干网络前向传播的2.6倍,且无需微调。

英文摘要:

Remote sensing visual question answering (RS-VQA) requires answers that truly depend on image evidence, yet current remote sensing multimodal large language models (RS MLLMs) are still evaluated mainly by accuracy, which cannot reveal whether a correct answer was produced without using the image. This setting introduces three challenges: demonstrations retrieved across different ground sample distances (GSD), sensors, and city textures may be poorly matched; real queries often involve long visual contexts from multi-scale tiles, multi-temporal frames, and retrieved knowledge, where evidence can be diluted and errors can propagate through multi-step reasoning; and prior-only answering remains invisible to standard metrics. We present AVA, a training-free framework that wraps a frozen RS MLLM with three modules. GDR performs GSD-bucketed, scene-graph-based demonstration retrieval and filters demonstrations whose answers are unsupported by their images. MACE decomposes each query into an evidence-typed sub-question DAG, routes sub-questions to suitable perception tools, and records verified provenance in a shared evidence ledger with bounded re-perception. CVA audits the final answer through counterfactual perturbations of cited evidence, including ablation and swap, and computes a visual-dependency score for confidence calibration and evidence-forcing re-query. On RSVQA-LR/HR, VRSBench, and LHRS-Bench, AVA improves average accuracy by up to 2.40 points over the strongest same-setting baselines, raises the visual-dependency score from 0.28 to 0.49, reduces the prior-only answer rate from 46.2 percent to 21.7 percent, and lowers the hallucination rate from 17.1 percent to 9.8 percent, with 2.6x the cost of a single backbone forward pass and no fine-tuning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑