arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2008.01421cs.CV
收藏

基于全卷积空间传播网络的空间一致性高光谱图像分类

Hyperspectral Image Classification with Spatial Consistence Using Fully Convolutional Spatial Propagation Network

Northwestern Polytechnical University(西北工业大学);The University of Adelaide(阿德莱德大学);The University of Melbourne(墨尔本大学)

Yenan Jiang, Ying Li, Shanrong Zou, Haokui Zhang, Yunpeng Bai

摘要:

近年来,深度卷积神经网络(CNN)在高光谱图像(HSI)的表示方面表现出了令人印象深刻的能力,并在HSI分类中取得了令人鼓舞的结果。然而,现有的基于CNN的模型都是在块级上进行分类,即利用像素周围的图像块对像素进行单独的分类,这种块级分类会导致大量的重复计算,并且难以确定合适的有利于分类精度的块大小。此外,传统的CNN模型与局部感受野进行卷积,这导致对上下文空间信息建模失败。为了克服上述限制,我们提出了一种新的端到端,像素到像素的全卷积空间传播网络(FCSPN)用于HSI分类。我们的FCSPN由3D全卷积网络(3D-FCN)和卷积空间传播网络(CSPN)组成。具体而言,3D-FCN首次引入可靠的初步分类,其中提出了一种新的双可分离残差(DSR)单元,以有效地捕获光谱和空间信息,同时与较少的参数。此外,在3D-FCN中采用了逐信道注意力机制,以从冗余信道信息中抓住信息量最大的信道。最后,CSPN通过学习局部线性空间传播来捕获HSI的空间相关性,这允许保持HSI的空间一致性并进一步细化分类结果。在三个HSI基准数据集上的实验结果表明,所提出的FCSPN在HSI分类上达到了最先进的性能。

英文摘要:

In recent years, deep convolutional neural networks (CNNs) have shown impressive ability to represent hyperspectral images (HSIs) and achieved encouraging results in HSI classification. However, the existing CNN-based models operate at the patch-level, in which pixel is separately classified into classes using a patch of images around it. This patch-level classification will lead to a large number of repeated calculations, and it is difficult to determine the appropriate patch size that is beneficial to classification accuracy. In addition, the conventional CNN models operate convolutions with local receptive fields, which cause failures in modeling contextual spatial information. To overcome the aforementioned limitations, we propose a novel end-to-end, pixels-to-pixels fully convolutional spatial propagation network (FCSPN) for HSI classification. Our FCSPN consists of a 3D fully convolution network (3D-FCN) and a convolutional spatial propagation network (CSPN). Specifically, the 3D-FCN is firstly introduced for reliable preliminary classification, in which a novel dual separable residual (DSR) unit is proposed to effectively capture spectral and spatial information simultaneously with fewer parameters. Moreover, the channel-wise attention mechanism is adapted in the 3D-FCN to grasp the most informative channels from redundant channel information. Finally, the CSPN is introduced to capture the spatial correlations of HSI via learning a local linear spatial propagation, which allows maintaining the HSI spatial consistency and further refining the classification results. Experimental results on three HSI benchmark datasets demonstrate that the proposed FCSPN achieves state-of-the-art performance on HSI classification.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑