arXivDaily arXiv每日学术速递 周一至周五更新
看起来今天可以划水了
arXiv 2501.01481eess.IVcs.CV
收藏

释放相关性与连续性:从RGB图像进行高光谱重建

Unleashing Correlation and Continuity for Hyperspectral Reconstruction from RGB Images

School of Control Science and Engineering, Shandong University(控制科学与工程学院,山东大学);Key Laboratory of Machine Intelligence and System Control, Ministry of Education(机器智能与系统控制重点实验室,教育部);University of California, Los Angeles(加州大学洛杉矶分校);Hubei Key Laboratory of Intelligent Geo-Information Processing, China University of Geosciences(智能地理信息处理重点实验室,中国地质大学);Lingnan University(岭大大学)

Fuxiang Feng, Runmin Cong, Shoushui Wei, Yipeng Zhang, Jun Li, Sam Kwong, Wei Zhang

AI总结:

提出相关性连续性网络(CCNet),通过局部光谱相关性建模(GrSCM)和全局光谱连续性建模(NeSCM)及自适应融合(PAF),实现RGB到高光谱图像的SOTA重建。

摘要:

从RGB图像重建高光谱图像(HSI)可以以较低成本获得高空间分辨率的HSI,显示出巨大的应用潜力。本文揭示了光谱特征的局部相关性和全局连续性对于HSI重建任务至关重要。因此,我们充分探索了这些光谱间关系,并提出了相关性连续性网络(CCNet)用于从RGB图像重建HSI。针对局部光谱的相关性,我们引入了分组光谱相关性建模(GrSCM)模块,该模块在局部范围内高效建立光谱波段相似性。针对全局光谱的连续性,我们设计了邻域光谱连续性建模(NeSCM)模块,该模块利用记忆单元递归地建模全局层面的渐进变化特征。为了探索这两个模块的内在互补性,我们设计了分块自适应融合(PAF)模块,以分块自适应方式将全局连续性特征高效集成到光谱特征中。这些创新提升了重建HSI的质量。我们在光谱重建任务的主流数据集NTIRE2022和NTIRE2020上进行了全面的比较和消融实验。与当前先进的光谱重建算法相比,我们设计的算法达到了最先进(SOTA)性能。

英文摘要:

Reconstructing Hyperspectral Images (HSI) from RGB images can yield high spatial resolution HSI at a lower cost, demonstrating significant application potential. This paper reveals that local correlation and global continuity of the spectral characteristics are crucial for HSI reconstruction tasks. Therefore, we fully explore these inter-spectral relationships and propose a Correlation and Continuity Network (CCNet) for HSI reconstruction from RGB images. For the correlation of local spectrum, we introduce the Group-wise Spectral Correlation Modeling (GrSCM) module, which efficiently establishes spectral band similarity within a localized range. For the continuity of global spectrum, we design the Neighborhood-wise Spectral Continuity Modeling (NeSCM) module, which employs memory units to recursively model the progressive variation characteristics at the global level. In order to explore the inherent complementarity of these two modules, we design the Patch-wise Adaptive Fusion (PAF) module to efficiently integrate global continuity features into the spectral features in a patch-wise adaptive manner. These innovations enhance the quality of reconstructed HSI. We perform comprehensive comparison and ablation experiments on the mainstream datasets NTIRE2022 and NTIRE2020 for the spectral reconstruction task. Compared to the current advanced spectral reconstruction algorithms, our designed algorithm achieves State-Of-The-Art (SOTA) performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑