arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2501.04643cs.CV
收藏

基于离散小波变换的胶囊网络用于高光谱图像分类

Discrete Wavelet Transform-Based Capsule Network for Hyperspectral Image Classification

Wenzhou-Kean University(温州肯恩大学);Hainan Normal University(海南师范大学);Southwest University(西南大学);Duke University(杜克大学);Duke Kunshan University(昆山杜克大学)

Zhiqiang Gao, Jiaqi Wang, Hangchi Shen, Zhihao Dou, Xiangbo Zhang, Kaizhu Huang

AI总结:

针对CapsNet全连接架构计算开销高的问题,提出DWT-CapsNet,通过DWT注意力下采样、多尺度剪枝路由和胶囊金字塔融合实现高效高精度HSI分类。

摘要:

高光谱图像(HSI)分类是遥感领域构建大规模地球监测系统的一项关键技术。与传统视觉图像相比,HSI包含多得多的信息,可用于识别土地覆盖类别。近期一种可行的HSI解决方案是利用CapsNets来捕获光谱-空间信息。然而,由于堆叠胶囊层之间采用全连接架构,这些方法需要很高的计算资源。为解决该问题,本文提出DWT-CapsNet,用于识别CapsNet中部分但重要的连接,以实现有效且高效的HSI分类。具体而言,我们将定制的注意力机制集成到基于离散小波变换(DWT)的下采样层中,以缓解特征提取器中传统下采样操作的信息丢失问题。此外,我们提出一种新颖的多尺度路由算法,可剪除CapsNet中的大部分连接。本文设计了胶囊金字塔融合机制,以聚合多种粒度层级的光谱-空间关系,随后在部分且局部连接的架构中进一步采用自注意力机制,以突出有意义的关系。实验结果表明,我们的方法取得了最先进的准确率,同时在运行时间、FLOPs和参数量方面保持较低的计算需求,使其成为HSI分类实际部署的一种有吸引力的选择。

英文摘要:

Hyperspectral image (HSI) classification is a crucial technique for remote sensing to build large-scale earth monitoring systems. HSI contains much more information than traditional visual images for identifying the categories of land covers. One recent feasible solution for HSI is to leverage CapsNets for capturing spectral-spatial information. However, these methods require high computational requirements due to the full connection architecture between stacked capsule layers. To solve this problem, a DWT-CapsNet is proposed to identify partial but important connections in CapsNet for a effective and efficient HSI classification. Specifically, we integrate a tailored attention mechanism into a Discrete Wavelet Transform (DWT)-based downsampling layer, alleviating the information loss problem of conventional downsampling operation in feature extractors. Moreover, we propose a novel multi-scale routing algorithm that prunes a large proportion of connections in CapsNet. A capsule pyramid fusion mechanism is designed to aggregate the spectral-spatial relationships in multiple levels of granularity, and then a self-attention mechanism is further conducted in a partially and locally connected architecture to emphasize the meaningful relationships. As shown in the experimental results, our method achieves state-of-the-art accuracy while keeping lower computational demand regarding running time, flops, and the number of parameters, rendering it an appealing choice for practical implementation in HSI classification.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑