arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2405.04595eess.IVcs.CV
收藏

一种用于遥感图像超分辨率的高级特征提取模块

An Advanced Features Extraction Module for Remote Sensing Image Super-Resolution

Chulalongkorn University(朱拉隆功大学)

Naveed Sultan, Amir Hajian, Supavadee Aramvith

AI总结:

针对遥感图像超分辨率中高频特征利用不足的问题,提出融合通道、空间注意力与ViT的CSA-FE模块,在UCMerced数据集上实现优于现有模型的重建质量。

摘要:

近年来,由于遥感图像(RSI)中的纹理和结构复杂多变,且这些纹理和结构常在同一图像内重复出现,却在不同图像之间存在差异,卷积神经网络(CNN)在遥感图像超分辨率领域取得了显著进展。当前基于深度学习的超分辨率模型对高频特征关注较少,导致其在捕捉轮廓、纹理和空间信息方面性能欠佳。目前最先进的基于CNN的方法侧重于利用注意力机制进行RSI的特征提取。然而,这些方法仍无法有效识别和利用RSI中的关键内容注意力信号。为解决这一问题,我们提出了一种名为通道与空间注意力特征提取(CSA-FE)的高级特征提取模块,通过将通道注意力和空间注意力与标准视觉transformer(ViT)相结合来有效提取特征。所提出的方法在UCMerced数据集上以2、3和4倍尺度进行了训练。实验结果表明,我们提出的方法有助于模型聚焦于包含高频信息的特定通道和空间位置,从而使模型能够关注相关特征并抑制无关特征,提升了超分辨率图像的质量。与多种现有模型相比,我们的模型取得了更优越的性能。

英文摘要:

In recent years, convolutional neural networks (CNNs) have achieved remarkable advancement in the field of remote sensing image super-resolution due to the complexity and variability of textures and structures in remote sensing images (RSIs), which often repeat in the same images but differ across others. Current deep learning-based super-resolution models focus less on high-frequency features, which leads to suboptimal performance in capturing contours, textures, and spatial information. State-of-the-art CNN-based methods now focus on the feature extraction of RSIs using attention mechanisms. However, these methods are still incapable of effectively identifying and utilizing key content attention signals in RSIs. To solve this problem, we proposed an advanced feature extraction module called Channel and Spatial Attention Feature Extraction (CSA-FE) for effectively extracting the features by using the channel and spatial attention incorporated with the standard vision transformer (ViT). The proposed method trained over the UCMerced dataset on scales 2, 3, and 4. The experimental results show that our proposed method helps the model focus on the specific channels and spatial locations containing high-frequency information so that the model can focus on relevant features and suppress irrelevant ones, which enhances the quality of super-resolved images. Our model achieved superior performance compared to various existing models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑