arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2306.00704cs.CV

DAM-Net:利用基于差分注意力度量的 Vision Transformer 从 SAR 影像中进行全球洪水检测

DAM-Net: Global Flood Detection from SAR Imagery Using Differential Attention Metric-Based Vision Transformers

Wuhan University(武汉大学);Benha University(本哈大学)

Tamer Saleh, Xingxing Weng, Shimaa Holail, Chen Hao, Gui-Song Xia

AI总结:

针对 SAR 洪水检测中范围高估和数据稀缺问题,本文提出 DAM-Net,通过孪生骨干、差分注意力模块与 TDF 融合生成低噪洪水图,并构建 S1GFloods 全球数据集,性能优于现有方法。

摘要:

利用高分辨率合成孔径雷达(SAR)影像检测洪水淹没区是一项关键任务,可应用于危机与灾害管理以及环境资源规划。然而,SAR 图像的复杂特性带来了挑战,往往导致洪水范围被高估。为解决这一问题,本研究提出了一种新颖的基于差分注意力度量的网络(DAM-Net)。DAM-Net 包含两个关键组件:一个权重共享的孪生骨干网络,用于获取多时相图像的多尺度变化特征以及包含水体变化高级语义信息的 token;以及一个时间差分融合(TDF)模块,该模块整合语义 token 和变化特征,以生成降低斑点噪声的洪水图。具体而言,骨干网络被划分为多个阶段。在每个阶段,我们设计了三个模块,即时间维度特征提取(TWFE)、跨时间变化注意力(CTCA)和时间感知变化增强(TACE),以有效提取变化特征。在最后一个阶段的 TACE 中,我们引入一个类别 token,通过注意力机制记录水体变化的高级语义信息。数据驱动深度学习算法面临的另一个挑战是洪水检测数据集的可用性有限。为克服这一问题,我们创建了 S1GFloods 开源数据集,这是一个全球尺度的高分辨率 Sentinel-1 SAR 图像对数据集,涵盖 2015 年至 2022 年间全球 46 次洪水事件。使用所提出的 DAM-Net 在 S1GFloods 数据集上进行的实验表明,与最先进方法相比,其在总体准确率、F1 分数和 IoU 方面取得了最佳结果,分别达到 97.8%、96.5% 和 93.2%。我们的数据集和代码将在 https://github.com/Tamer-Saleh/S1GFlood-Detection 在线提供。

英文摘要:

The detection of flooded areas using high-resolution synthetic aperture radar (SAR) imagery is a critical task with applications in crisis and disaster management, as well as environmental resource planning. However, the complex nature of SAR images presents a challenge that often leads to an overestimation of the flood extent. To address this issue, we propose a novel differential attention metric-based network (DAM-Net) in this study. The DAM-Net comprises two key components: a weight-sharing Siamese backbone to obtain multi-scale change features of multi-temporal images and tokens containing high-level semantic information of water-body changes, and a temporal differential fusion (TDF) module that integrates semantic tokens and change features to generate flood maps with reduced speckle noise. Specifically, the backbone is split into multiple stages. In each stage, we design three modules, namely, temporal-wise feature extraction (TWFE), cross-temporal change attention (CTCA), and temporal-aware change enhancement (TACE), to effectively extract the change features. In TACE of the last stage, we introduce a class token to record high-level semantic information of water-body changes via the attention mechanism. Another challenge faced by data-driven deep learning algorithms is the limited availability of flood detection datasets. To overcome this, we have created the S1GFloods open-source dataset, a global-scale high-resolution Sentinel-1 SAR image pairs dataset covering 46 global flood events between 2015 and 2022. The experiments on the S1GFloods dataset using the proposed DAM-Net showed top results compared to state-of-the-art methods in terms of overall accuracy, F1-score, and IoU, which reached 97.8%, 96.5%, and 93.2%, respectively. Our dataset and code will be available online at https://github.com/Tamer-Saleh/S1GFlood-Detection.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑