基于超瑞利散斑的深度学习高光谱图像重建
Hyperspectral image reconstruction by deep learning with super-Rayleigh speckles
AI总结:
本文提出结合超瑞利散斑调制的端到端GISCnet,通过深度学习重建三维高光谱图像,将平均峰值信噪比从27 dB提升至31 dB,有效改善GISC光谱相机成像质量。
摘要:
基于稀疏约束的鬼成像(GISC)光谱相机通过散斑在单次拍摄中将三维(3D)高光谱图像调制为二维(2D)压缩图像。它通过重建算法获得三维高光谱图像(HSI)。深度学习的快速发展为三维HSI重建提供了新方法。此外,通过优化散斑调制可以提高GISC光谱相机的成像性能。本文提出了一种端到端的GISCnet,并采用超瑞利散斑调制来提高GISC光谱相机的成像质量。GISCnet的结构非常简单但有效,我们可以轻松调整网络结构参数以提高图像重建质量。相对于瑞利散斑,我们的超瑞利散斑调制在重建三维HSI时展现出丰富的细节。在评估648个三维HSI后,发现平均峰值信噪比从27 dB提高到31 dB。总体而言,所提出的带有超瑞利散斑调制的GISCnet通过结合优化的超瑞利调制和深度学习图像重建的优势,有效提高了GISC光谱相机的成像质量,为联合优化光场调制和图像重建以提高鬼成像性能提供了启发。
英文摘要:
Ghost imaging via sparsity constraints (GISC) spectral camera modulates the three-dimensional (3D) hyperspectral image into a two-dimensional (2D) compressive image with speckles in a single shot. It obtains a 3D hyperspectral image (HSI) by reconstruction algorithms. The rapid development of deep learning has provided a new method for 3D HSI reconstruction. Moreover, the imaging performance of the GISC spectral camera can be improved by optimizing the speckle modulation. In this paper, we propose an end-to-end GISCnet with super-Rayleigh speckle modulation to improve the imaging quality of the GISC spectral camera. The structure of GISCnet is very simple but effective, and we can easily adjust the network structure parameters to improve the image reconstruction quality. Relative to Rayleigh speckles, our super-Rayleigh speckles modulation exhibits a wealth of detail in reconstructing 3D HSIs. After evaluating 648 3D HSIs, it was found that the average peak signal-to-noise ratio increased from 27 dB to 31 dB. Overall, the proposed GISCnet with super-Rayleigh speckle modulation can effectively improve the imaging quality of the GISC spectral camera by taking advantage of both optimized super-Rayleigh modulation and deep-learning image reconstruction, inspiring joint optimization of light-field modulation and image reconstruction to improve ghost imaging performance.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。