arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.06705cs.CV

HSR-KAN: 通过 Kolmogorov-Arnold 网络高效实现超分辨率 hyperspectral 图像

HSR-KAN: Efficient Hyperspectral Image Super-Resolution via Kolmogorov-Arnold Networks

College of Computer Science and Technology, Jilin University(吉林大学计算机科学与技术学院)

Baisong Li, Xingwang Wang, Haixiao Xu

AI总结:

HSR-KAN 通过 Kolmogorov-Arnold 网络实现超分辨率 hyperspectral 图像的高效融合与提升,结合通道注意力机制以增强细节模拟和避免维度灾难。

摘要:

超光谱图像(HSI)由于其丰富的光谱信息,在各种视觉任务中具有巨大潜力。然而,由于物理成像的限制,获得高分辨率的超光谱图像仍然具有挑战性。受 Kolmogorov-Arnold 网络(KANs)的启发,我们提出了一种高效的 HSI 超分辨率(HSI-SR)模型,用于融合低分辨率 HSI(LR-HSI)和高分辨率多光谱图像(HR-MSI),以获得高分辨率 HSI(HR-HSI)。为了实现 HR-MSI 的空间信息的有效整合,我们设计了一个基于 KANs 的融合模块,称为 KAN-Fusion。进一步受通道注意力机制的启发,我们设计了一个称为 KAN 通道注意力模块(KAN-CAB)的光谱通道注意力模块,用于后融合特征提取。作为集成 KANs 的通道注意力模块,KAN-CAB 不仅增强了深度网络的精细调整能力,使网络能够准确模拟光谱序列和空间纹理的细节,还有效避免了维度灾难。广泛的实验表明,与当前最先进的 HSI-SR 方法相比,提出的 HSR-KAN 在定性和定量评估方面均取得了最佳性能。我们的代码可在:https://github.com/Baisonm-Li/HSR-KAN 上获得。

英文摘要:

Hyperspectral images (HSIs) have great potential in various visual tasks due to their rich spectral information. However, obtaining high-resolution hyperspectral images remains challenging due to limitations of physical imaging. Inspired by Kolmogorov-Arnold Networks (KANs), we propose an efficient HSI super-resolution (HSI-SR) model to fuse a low-resolution HSI (LR-HSI) and a high-resolution multispectral image (HR-MSI), yielding a high-resolution HSI (HR-HSI). To achieve the effective integration of spatial information from HR-MSI, we design a fusion module based on KANs, called KAN-Fusion. Further inspired by the channel attention mechanism, we design a spectral channel attention module called KAN Channel Attention Block (KAN-CAB) for post-fusion feature extraction. As a channel attention module integrated with KANs, KAN-CAB not only enhances the fine-grained adjustment ability of deep networks, enabling networks to accurately simulate details of spectral sequences and spatial textures, but also effectively avoid Curse of Dimensionality. Extensive experiments show that, compared to current state-of-the-art HSI-SR methods, proposed HSR-KAN achieves the best performance in terms of both qualitative and quantitative assessments. Our code is available at: https://github.com/Baisonm-Li/HSR-KAN.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑