arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.09673cs.CV
收藏

基于卫星图像时间序列的作物分类方法SITSMamba

SITSMamba for Crop Classification based on Satellite Image Time Series

Wuhan University(武汉大学);State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing(遥感信息工程国家重点实验室);School of Remote Sensing and Information Engineering(遥感信息工程学院)

Xiaolei Qin, Xin Su, Liangpei Zhang

AI总结:

本文提出SITSMamba方法,结合CNN空间编码器与Mamba时序编码器,并通过分类与重建双分支及位置权重充分利用时序信息,实现高效作物分类。

摘要:

卫星图像时间序列(SITS)数据提供了随时间连续的观测,能够追踪整个季节和年份中植被变化与生长模式。近年来,涌现出大量利用SITS进行作物分类的深度学习方法,其中最新方法采用Transformer进行SITS分类。然而,Transformer中自注意力的二次复杂度给长时序分类带来了挑战。尽管前沿的Mamba架构已在包括遥感图像解译在内的多个领域展现出优势,但其在SITS数据中学习时序表示的能力尚未被探索。此外,现有SITS分类方法往往仅依赖作物标签作为监督信号,未能充分利用时序信息。本文提出了一种基于遥感时间序列数据的卫星图像时间序列Mamba(SITSMamba)作物分类方法。所提出的SITSMamba包含一个基于卷积神经网络(CNN)的空间编码器和一个基于Mamba的时序编码器。为从SITS中挖掘更丰富的时序信息,我们设计了两个用于不同任务的解码器分支。第一个分支是作物分类分支(CBranch),其中包含一个ConvBlock,用于将特征解码为作物图。第二个分支是SITS重建分支,使用线性层对编码特征进行变换以预测原始输入值。此外,我们设计了一种应用于重建分支的位置权重(PW),帮助模型从SITS中学习丰富的潜在知识。我们还设计了两个权重因子,用于在训练过程中控制两个分支的平衡。SITSMamba的代码可在以下地址获取:https://github.com/XiaoleiQinn/SITSMamba。

英文摘要:

Satellite image time series (SITS) data provides continuous observations over time, allowing for the tracking of vegetation changes and growth patterns throughout the seasons and years. Numerous deep learning (DL) approaches using SITS for crop classification have emerged recently, with the latest approaches adopting Transformer for SITS classification. However, the quadratic complexity of self-attention in Transformer poses challenges for classifying long time series. While the cutting-edge Mamba architecture has demonstrated strength in various domains, including remote sensing image interpretation, its capacity to learn temporal representations in SITS data remains unexplored. Moreover, the existing SITS classification methods often depend solely on crop labels as supervision signals, which fails to fully exploit the temporal information. In this paper, we proposed a Satellite Image Time Series Mamba (SITSMamba) method for crop classification based on remote sensing time series data. The proposed SITSMamba contains a spatial encoder based on Convolutional Neural Networks (CNN) and a Mamba-based temporal encoder. To exploit richer temporal information from SITS, we design two branches of decoder used for different tasks. The first branch is a crop Classification Branch (CBranch), which includes a ConvBlock to decode the feature to a crop map. The second branch is a SITS Reconstruction Branch that uses a Linear layer to transform the encoded feature to predict the original input values. Furthermore, we design a Positional Weight (PW) applied to the RBranch to help the model learn rich latent knowledge from SITS. We also design two weighting factors to control the balance of the two branches during training. The code of SITSMamba is available at: https://github.com/XiaoleiQinn/SITSMamba.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑