arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2005.14400eess.IVcs.CV
收藏

基于深空谱卷积神经网络的高光谱图像超分辨率

Hyperspectral Image Super-resolution via Deep Spatio-spectral Convolutional Neural Networks

University of Electronic Science and Technology of China(电子科技大学);Southwestern University of Finance and Economics(西南财经大学);University of Salerno(萨勒诺大学);Institute of Methodologies for Environmental Analysis, CNR-IMAA(意大利国家研究委员会环境分析方法研究所);Univ. Grenoble Alpes(格勒诺布尔阿尔卑斯大学);Inria(法国国家信息与自动化研究所);CNRS(法国国家科学研究中心);Grenoble INP(格勒诺布尔国立理工学院)

Jin-Fan Hu, Ting-Zhu Huang, Liang-Jian Deng, Tai-Xiang Jiang, Gemine Vivone, Jocelyn Chanussot

摘要:

高光谱图像对于更好地了解不同材料的特性至关重要。为了实现这一目标,他们利用了大量的光谱波段。然而,这种有趣的特性往往是支付的空间分辨率降低相比,传统的多光谱图像系统。为了缓解这个问题,在这项工作中,我们提出了一种简单有效的深度卷积神经网络架构,用于融合低分辨率高光谱图像(LR-HSI)和高分辨率多光谱图像(HR-MSI),产生高分辨率高光谱图像(HR-HSI)。该网络的设计是为了保留空间和光谱信息,这要归功于两个方面的架构:一个是利用不同尺度的HR-HSI来获得具有满意光谱保留的输出;另一个是应用多分辨率分析的概念来提取高频信息,旨在输出高质量的空间细节。最后,一个普通的均方误差损失函数被用来衡量在训练过程中的性能。大量的实验表明,所提出的网络架构实现最佳的性能(定性和定量)相比,最近的国家的最先进的高光谱图像超分辨率的方法。此外,其他显着的优点,可以指出,通过使用所提出的方法,如更好的网络泛化能力,有限的计算负担,以及相对于训练样本的数量的鲁棒性。

英文摘要:

Hyperspectral images are of crucial importance in order to better understand features of different materials. To reach this goal, they leverage on a high number of spectral bands. However, this interesting characteristic is often paid by a reduced spatial resolution compared with traditional multispectral image systems. In order to alleviate this issue, in this work, we propose a simple and efficient architecture for deep convolutional neural networks to fuse a low-resolution hyperspectral image (LR-HSI) and a high-resolution multispectral image (HR-MSI), yielding a high-resolution hyperspectral image (HR-HSI). The network is designed to preserve both spatial and spectral information thanks to an architecture from two folds: one is to utilize the HR-HSI at a different scale to get an output with a satisfied spectral preservation; another one is to apply concepts of multi-resolution analysis to extract high-frequency information, aiming to output high quality spatial details. Finally, a plain mean squared error loss function is used to measure the performance during the training. Extensive experiments demonstrate that the proposed network architecture achieves best performance (both qualitatively and quantitatively) compared with recent state-of-the-art hyperspectral image super-resolution approaches. Moreover, other significant advantages can be pointed out by the use of the proposed approach, such as, a better network generalization ability, a limited computational burden, and a robustness with respect to the number of training samples.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑