arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2603.19039cs.CV

TerraScope:基于像素的视觉推理用于地球观测

TerraScope: Pixel-Grounded Visual Reasoning for Earth Observation

University of Trento(特伦托大学);BIFOLD and TU Berlin(BIFOLD和柏林技术大学);Technical University of Munich(慕尼黑技术大学);MBZUAI

Yan Shu, Bin Ren, Zhitong Xiong, Xiao Xiang Zhu, Begüm Demir, Nicu Sebe, Paolo Rota

AI总结:

TerraScope通过模态灵活推理和多时序推理,提升地球观测中像素级空间推理能力,提出Terra-CoT数据集和TerraScope-Bench基准,验证其在像素级地理空间推理中的优越性。

摘要:

TerraScope通过模态灵活推理和多时序推理,提升地球观测中像素级空间推理能力,提出Terra-CoT数据集和TerraScope-Bench基准,验证其在像素级地理空间推理中的优越性。

英文摘要:

Vision-language models (VLMs) have shown promise in earth observation (EO), yet they struggle with tasks that require grounding complex spatial reasoning in precise pixel-level visual representations. To address this problem, we introduce TerraScope, a unified VLM that delivers pixel-grounded geospatial reasoning with two key capabilities: (1) modality-flexible reasoning: it handles single-modality inputs (optical or SAR) and adaptively fuses different modalities into the reasoning process when both are available; (2) multi-temporal reasoning: it integrates temporal sequences for change analysis across multiple time points. In addition, we curate Terra-CoT, a large-scale dataset containing 1 million samples with pixel-level masks embedded in reasoning chains across multiple sources. We also propose TerraScope-Bench, the first benchmark for pixel-grounded geospatial reasoning with six sub-tasks that evaluates both answer accuracy and mask quality to ensure authentic pixel-grounded reasoning. Experiments show that TerraScope significantly outperforms existing VLMs on pixel-grounded geospatial reasoning while providing interpretable visual evidence.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑