arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2106.07066eess.IVcs.LGeess.SP
收藏

基于RGB融合和TV-TV最小化的高光谱图像超分辨率增强

Enhanced Hyperspectral Image Super-Resolution via RGB Fusion and TV-TV Minimization

Institute of Sensors, Signals and Systems, Heriot-Watt University(赫瑞-瓦特大学传感器、信号与系统研究所);State Key Laboratory of Rail Traffic Control and Safety, Beijing Jiaotong University(北京交通大学轨道交通控制与安全国家重点实验室)

Marija Vella, Bowen Zhang, Wei Chen, João F. C. Mota

摘要:

高光谱(HS)图像包含详细的光谱信息,已被证明在遥感,监视和天文学等应用中至关重要。然而,由于HS相机的硬件限制,所捕获的图像具有低空间分辨率。为了改善它们,低分辨率的高光谱图像与传统的高分辨率RGB图像通过一种称为基于融合的HS图像超分辨率的技术进行融合。目前,这项任务的最佳性能是通过深度学习(DL)方法实现的。然而,这样的方法不能保证在恢复的图像中满足输入测量,因为通过网络学习的参数被应用于每个测试图像。相反,基于模型的算法通常可以保证这种测量的一致性。受这些观察的启发,我们提出了一个框架,集成了学习和基于模型的方法。实验结果表明,我们的方法相比,目前领先的方法,无论是基于模型或DL产生优越的空间和光谱分辨率的图像。

英文摘要:

Hyperspectral (HS) images contain detailed spectral information that has proven crucial in applications like remote sensing, surveillance, and astronomy. However, because of hardware limitations of HS cameras, the captured images have low spatial resolution. To improve them, the low-resolution hyperspectral images are fused with conventional high-resolution RGB images via a technique known as fusion based HS image super-resolution. Currently, the best performance in this task is achieved by deep learning (DL) methods. Such methods, however, cannot guarantee that the input measurements are satisfied in the recovered image, since the learned parameters by the network are applied to every test image. Conversely, model-based algorithms can typically guarantee such measurement consistency. Inspired by these observations, we propose a framework that integrates learning and model based methods. Experimental results show that our method produces images of superior spatial and spectral resolution compared to the current leading methods, whether model- or DL-based.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑