arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2604.14044cs.CV

解读Delta:利用多模态大语言模型统一遥感变化检测与理解

Decoding the Delta: Unifying Remote Sensing Change Detection and Understanding with Multimodal Large Language Models

Aerospace Information Research Institute, CAS(航天信息研究所,中国科学院);Space Engineering University(航天工程大学);Capital Normal University(首都师范大学)

Xiaohe Li, Jiahao Li, Kaixin Zhang, Yuqiang Fang, Leilei Lin, Hong Wang, Haohua Wu, Zide Fan

AI总结:

本文提出Delta-LLaVA框架,通过多时间尺度对比推理和空间定位,解决遥感变化理解中的时间盲问题,实现像素级分割与视觉问答的统一。

摘要:

尽管多模态大语言模型(MLLMs)在通用视觉-语言任务中表现优异,但其在遥感变化理解中的应用受限于根本性的"时间盲"问题。现有架构缺乏内在的多时间对比推理机制,难以实现精确的空间定位。为此,我们首先引入Delta-QA基准,包含180,000个视觉问答样本,统一了双时间与三时间场景下的像素分割和视觉问答。方法上,我们提出Delta-LLaVA,一种专门针对多时间遥感解释的新型MLLM框架。通过三个核心创新:变化增强注意力模块系统性地隔离和放大视觉差异,变化先验嵌入模块提取可微差异特征作为LLM输入,以及局部因果注意力模块防止跨时间上下文泄漏。大量实验表明,Delta-LLaVA在复杂变化推断和高精度边界定位方面显著优于领先的一般化MLLMs和专门化的分割模型,建立了地球观测智能的统一框架。

英文摘要:

While Multimodal Large Language Models (MLLMs) excel in general vision-language tasks, their application to remote sensing change understanding is hindered by a fundamental "temporal blindness". Existing architectures lack intrinsic mechanisms for multi-temporal contrastive reasoning and struggle with precise spatial grounding. To address this, we first introduce Delta-QA, a comprehensive benchmark comprising 180k visual question-answering samples. Delta-QA unifies pixel-level segmentation and visual question answering across bi- and tri-temporal scenarios, structuring change interpretation into four progressive cognitive dimensions. Methodologically, we propose Delta-LLaVA, a novel MLLM framework explicitly tailored for multi-temporal remote sensing interpretation. It overcomes the limitations of naive feature concatenation through three core innovations: a Change-Enhanced Attention module that systematically isolates and amplifies visual differences, a Change-SEG module utilizing Change Prior Embedding to extract differentiable difference features as input for the LLM, and Local Causal Attention to prevent cross-temporal contextual leakage. Extensive experiments demonstrate that Delta-LLaVA decisively outperforms leading generalist MLLMs and specialized segmentation models in complex change deduction and high-precision boundary localization, establishing a unified framework for earth observation intelligence.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑