arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2510.22964cs.CV

多模态地理空间基础模型综述:技术、应用与挑战

Survey of Multimodal Geospatial Foundation Models: Techniques, Applications, and Challenges

School of Artificial Intelligence and Robotics, Hunan University(湖南大学人工智能与机器人学院);Institute of Remote Sensing and Geographic Information System, Peking University(北京大学遥感与地理信息系统研究所);School of Automation, Central South University(中南大学自动化学院);Electronic Information School, Wuhan University(武汉大学电子信息学院);Helmholtz-Zentrum Dresden-Rossendorf(德累斯顿-罗斯托克亥姆霍尔茨中心);Lancaster Environment Centre, Lancaster University(兰卡斯特大学环境研究中心);Hyperspectral Computing Laboratory, Department of Technology of Computers and Communications, Escuela Politécnica, University of Extremadura(埃斯特雷马杜拉大学技术计算机与通讯系超光谱计算实验室)

Liling Yang, Ning Chen, Jun Yue, Yidan Liu, Jiayi Ma, Pedram Ghamisi, Antonio Plaza, Leyuan Fang

AI总结:

本综述从模态驱动视角全面梳理多模态地理空间基础模型,分析对齐与知识迁移技术,评估其在十项下游任务中的表现,并指出领域泛化、可解释性等挑战与未来方向。

摘要:

基础模型已经变革了自然语言处理和计算机视觉领域,其影响如今正在重塑遥感图像分析。凭借强大的泛化能力和迁移学习能力,它们与遥感数据的多模态、多分辨率及多时相特性天然契合。为应对该领域的独特挑战,多模态地理空间基础模型(GFMs)已成为一个专门的研究前沿。本综述从模态驱动的视角对多模态GFMs进行了全面回顾,涵盖了五种核心视觉及视觉-语言模态。我们考察了成像物理和数据表示的差异如何塑造交互设计,并分析了用于对齐、融合和知识迁移的关键技术,以应对模态异质性、分布偏移和语义鸿沟。本文系统评估了训练范式、架构和任务特定自适应策略的进展,同时结合了大量新兴基准。我们评估了具有代表性的多模态视觉及视觉-语言GFMs在十项下游任务上的表现,并深入分析了它们的架构、性能和应用场景。涵盖土地覆盖制图、农业监测、灾害响应、气候研究和地理空间情报等真实世界案例研究,展示了GFMs的实际潜力。最后,我们概述了领域泛化、可解释性、效率和隐私方面的紧迫挑战,并描绘了未来研究的有前景方向。

英文摘要:

Foundation models have transformed natural language processing and computer vision, and their impact is now reshaping remote sensing image analysis. With powerful generalization and transfer learning capabilities, they align naturally with the multimodal, multi-resolution, and multi-temporal characteristics of remote sensing data. To address unique challenges in the field, multimodal geospatial foundation models (GFMs) have emerged as a dedicated research frontier. This survey delivers a comprehensive review of multimodal GFMs from a modality-driven perspective, covering five core visual and vision-language modalities. We examine how differences in imaging physics and data representation shape interaction design, and we analyze key techniques for alignment, integration, and knowledge transfer to tackle modality heterogeneity, distribution shifts, and semantic gaps. Advances in training paradigms, architectures, and task-specific adaptation strategies are systematically assessed alongside a wealth of emerging benchmarks. Representative multimodal visual and vision-language GFMs are evaluated across ten downstream tasks, with insights into their architectures, performance, and application scenarios. Real-world case studies, spanning land cover mapping, agricultural monitoring, disaster response, climate studies, and geospatial intelligence, demonstrate the practical potential of GFMs. Finally, we outline pressing challenges in domain generalization, interpretability, efficiency, and privacy, and chart promising avenues for future research.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑