arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.09019eess.IVcs.AIcs.CVcs.MM

基于分割任意模型(SAM)的光学遥感影像与地图数据变化检测

Change Detection Between Optical Remote Sensing Imagery and Map Data via Segment Anything Model (SAM)

The University of Tokyo(东京大学)

Hongruixuan Chen, Jian Song, Naoto Yokoya

AI总结:

本文利用SAM的零样本分割能力,在分割域中直接比较光学遥感影像与OSM数据,并通过无提示和框/掩码提示两种策略实现无监督多模态变化检测,在三个数据集上取得优于代表性方法的结果。

摘要:

无监督多模态变化检测对于时间敏感任务和全面的多时相地球监测至关重要。本研究探索了两种关键遥感数据源之间的无监督多模态变化检测:光学高分辨率影像和OpenStreetMap(OSM)数据。具体而言,我们提出利用视觉基础模型Segment Anything Model(SAM)来解决该任务。借助SAM卓越的零样本迁移能力,可以获得光学影像的高质量分割图。因此,我们可以在所谓的分割域中直接比较这两种异构数据形式。随后,我们引入两种策略来引导SAM的分割过程:“无提示”方法和“框/掩码提示”方法。这两种策略分别设计用于检测一般场景中的土地覆盖变化,以及识别现有背景中新增的土地覆盖目标。在三个数据集上的实验结果表明,与具有代表性的无监督多模态变化检测方法相比,所提方法能够取得更具竞争力的结果。

英文摘要:

Unsupervised multimodal change detection is pivotal for time-sensitive tasks and comprehensive multi-temporal Earth monitoring. In this study, we explore unsupervised multimodal change detection between two key remote sensing data sources: optical high-resolution imagery and OpenStreetMap (OSM) data. Specifically, we propose to utilize the vision foundation model Segmentation Anything Model (SAM), for addressing our task. Leveraging SAM's exceptional zero-shot transfer capability, high-quality segmentation maps of optical images can be obtained. Thus, we can directly compare these two heterogeneous data forms in the so-called segmentation domain. We then introduce two strategies for guiding SAM's segmentation process: the 'no-prompt' and 'box/mask prompt' methods. The two strategies are designed to detect land-cover changes in general scenarios and to identify new land-cover objects within existing backgrounds, respectively. Experimental results on three datasets indicate that the proposed approach can achieve more competitive results compared to representative unsupervised multimodal change detection methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑