arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2511.16853cs.CV

面向地球观测森林生态分析的统一视觉语言模型

Towards Unified Vision Language Models for Forest Ecological Analysis in Earth Observation

Xizhe Xue 1, 2;Xiao Xiang Zhu 1, 2

Xizhe Xue, Xiao Xiang Zhu

AI总结:

REO-Instruct提出首个面向地球观测森林生态分析的统一视觉语言模型基准,旨在解决描述与回归任务中的多模态感知与生物物理变量对齐问题。

摘要:

近期视觉语言模型(VLMs)的进步使显著的感知和推理能力成为可能,然而其在地球观测(EO)中的科学回归潜力仍 largely 未被探索。现有EO数据集主要强调语义理解任务,如描述或分类,缺乏将多模态感知与可测量生物物理变量对齐的基准。为此,我们提出了REO-Instruct,首个针对EO中描述和回归任务的统一基准。REO-Instruct在森林生态场景(人类活动、土地覆盖分类、生态斑块计数、地上生物量(AGB)回归)中建立了一种认知可解释的逻辑链,连接定性理解与定量预测。数据集整合了同步的Sentinel-2和ALOS-2影像与结构化文本注释,这些注释通过混合的人工智能管道生成并验证。全面的评估协议和跨通用VLMs的基线结果表明,当前模型在数值推理方面存在困难,突显了科学VLMs的重要挑战。REO-Instruct为开发和评估下一代地理空间模型提供了标准化的基础,这些模型能够同时进行描述和科学推断。项目页面可在https://github.com/zhu-xlab/REO-Instruct上公开获取。

英文摘要:

Recent progress in vision language models (VLMs) has enabled remarkable perception and reasoning capabilities, yet their potential for scientific regression in Earth Observation (EO) remains largely unexplored. Existing EO datasets mainly emphasize semantic understanding tasks such as captioning or classification, lacking benchmarks that align multimodal perception with measurable biophysical variables. To fill this gap, we present REO-Instruct, the first unified benchmark designed for both descriptive and regression tasks in EO. REO-Instruct establishes a cognitively interpretable logic chain in forest ecological scenario (human activity,land-cover classification, ecological patch counting, above-ground biomass (AGB) regression), bridging qualitative understanding and quantitative prediction. The dataset integrates co-registered Sentinel-2 and ALOS-2 imagery with structured textual annotations generated and validated through a hybrid human AI pipeline. Comprehensive evaluation protocols and baseline results across generic VLMs reveal that current models struggle with numeric reasoning, highlighting an essential challenge for scientific VLMs. REO-Instruct offers a standardized foundation for developing and assessing next-generation geospatial models capable of both description and scientific inference. The project page are publicly available at \href{https://github.com/zhu-xlab/REO-Instruct}{REO-Instruct}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑