arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2601.04497cs.CVcs.AIcs.CL
收藏

用于交互式森林变化分析的视觉-语言代理

Vision-Language Agents for Interactive Forest Change Analysis

James Brock, Ce Zhang, Nantheera Anantrasirichai

AI总结:

本文提出一种基于大语言模型的视觉-语言代理,用于处理遥感图像变化解释任务,通过多级变化解释框架和交互式查询提升森林变化分析的准确性与效率。

摘要:

现代森林监测工作流程越来越多地受益于高分辨率卫星图像的可用性和深度学习的进步。在此背景下,两个持续存在的挑战是准确的像素级变化检测和复杂森林动态的有意义的语义变化描述。虽然大型语言模型(LLMs)正在被适应用于交互式数据探索,但其与视觉-语言模型(VLMs)在遥感图像变化解释(RSICI)中的整合仍处于探索阶段。为了解决这一差距,我们引入了一个由LLM驱动的集成森林变化分析代理,支持在多个RSICI任务中进行自然语言查询。所提出系统基于多级变化解释(MCI)视觉-语言骨干网络,并结合LLM进行协调。为了促进森林环境中的适应和评估,我们进一步引入了Forest-Change数据集,该数据集包含双时相卫星图像、像素级变化掩码以及通过人类注释和基于规则的方法生成的多粒度语义变化描述。实验结果表明,所提出系统在Forest-Change数据集上实现了mIoU和BLEU-4分数分别为67.10%和40.17%,在LEVIR-MCI-Trees数据集上分别达到88.13%和34.41%。这些结果突显了交互式、LLM驱动的RSICI系统在提高森林变化分析可访问性、可解释性和效率方面的潜力。所有数据和代码均在https://github.com/JamesBrockUoB/ForestChat上公开。

英文摘要:

Modern forest monitoring workflows increasingly benefit from the growing availability of high-resolution satellite imagery and advances in deep learning. Two persistent challenges in this context are accurate pixel-level change detection and meaningful semantic change captioning for complex forest dynamics. While large language models (LLMs) are being adapted for interactive data exploration, their integration with vision-language models (VLMs) for remote sensing image change interpretation (RSICI) remains underexplored. To address this gap, we introduce an LLM-driven agent for integrated forest change analysis that supports natural language querying across multiple RSICI tasks. The proposed system builds upon a multi-level change interpretation (MCI) vision-language backbone with LLM-based orchestration. To facilitate adaptation and evaluation in forest environments, we further introduce the Forest-Change dataset, which comprises bi-temporal satellite imagery, pixel-level change masks, and multi-granularity semantic change captions generated using a combination of human annotation and rule-based methods. Experimental results show that the proposed system achieves mIoU and BLEU-4 scores of 67.10% and 40.17% on the Forest-Change dataset, and 88.13% and 34.41% on LEVIR-MCI-Trees, a tree-focused subset of LEVIR-MCI benchmark for joint change detection and captioning. These results highlight the potential of interactive, LLM-driven RSICI systems to improve accessibility, interpretability, and efficiency of forest change analysis. All data and code are publicly available at https://github.com/JamesBrockUoB/ForestChat.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑