Unleashing Correlation and Continuity for Hyperspectral Reconstruction from RGB Images
School of Control Science and Engineering, Shandong University(控制科学与工程学院,山东大学);Key Laboratory of Machine Intelligence and System Control, Ministry of Education(机器智能与系统控制重点实验室,教育部);University of California, Los Angeles(加州大学洛杉矶分校);Hubei Key Laboratory of Intelligent Geo-Information Processing, China University of Geosciences(智能地理信息处理重点实验室,中国地质大学);Lingnan University(岭大大学)
Fuxiang Feng, Runmin Cong, Shoushui Wei, Yipeng Zhang, Jun Li, Sam Kwong, Wei Zhang
Reconstructing Hyperspectral Images (HSI) from RGB images can yield high spatial resolution HSI at a lower cost, demonstrating significant application potential. This paper reveals that local correlation and global continuity of the spectral characteristics are crucial for HSI reconstruction tasks. Therefore, we fully explore these inter-spectral relationships and propose a Correlation and Continuity Network (CCNet) for HSI reconstruction from RGB images. For the correlation of local spectrum, we introduce the Group-wise Spectral Correlation Modeling (GrSCM) module, which efficiently establishes spectral band similarity within a localized range. For the continuity of global spectrum, we design the Neighborhood-wise Spectral Continuity Modeling (NeSCM) module, which employs memory units to recursively model the progressive variation characteristics at the global level. In order to explore the inherent complementarity of these two modules, we design the Patch-wise Adaptive Fusion (PAF) module to efficiently integrate global continuity features into the spectral features in a patch-wise adaptive manner. These innovations enhance the quality of reconstructed HSI. We perform comprehensive comparison and ablation experiments on the mainstream datasets NTIRE2022 and NTIRE2020 for the spectral reconstruction task. Compared to the current advanced spectral reconstruction algorithms, our designed algorithm achieves State-Of-The-Art (SOTA) performance.
A survey on computational spectral reconstruction methods from RGB to hyperspectral imaging
University of Chinese Academy of Sciences(中国科学院大学);Xidian University(西安电子科技大学);King Abdullah University of Science and Technology(阿卜杜拉国王科技大学);Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);Princeton University(普林斯顿大学);Vrije Universiteit Brussel(布鲁塞尔自由大学)
A self-supervised and adversarial approach to hyperspectral demosaicking and RGB reconstruction in surgical imaging
School of Biomedical Engineering & Imaging Sciences King’s College London London, UK(生物医学工程与成像科学学院 英国伦敦国王学院);Department of Neurosurgery King’s College Hospital NHS Foundation Trust, London, UK(神经外科部门 英国伦敦国王学院医院 NHS基金会信托)
Lightweight Interpretable RGB-Guided Hyperspectral Super-Resolution under Real Cross-resolution Misalignment
Univ. Grenoble Alpes(格勒诺布尔阿尔卑斯大学);CNRS Grenoble INP(法国国家科学研究中心格勒诺布尔国立理工学院);GIPSA-Lab(格勒诺布尔图像、信号、声学与自动化实验室);Institut Universitaire de France (IUF)(法国大学研究院)
Enhanced Hyperspectral Image Super-Resolution via RGB Fusion and TV-TV Minimization
Institute of Sensors, Signals and Systems, Heriot-Watt University(赫瑞-瓦特大学传感器、信号与系统研究所);State Key Laboratory of Rail Traffic Control and Safety, Beijing Jiaotong University(北京交通大学轨道交通控制与安全国家重点实验室)
Spectral-Spatial Recurrent-Convolutional Networks for In-Vivo Hyperspectral Tumor Type Classification
Hamburg University of Technology(汉堡工业大学);Carl von Ossietzky University Oldenburg(奥尔登堡大学);University Medical Center Hamburg-Eppendorf(汉堡-埃彭多夫大学医学中心);University of Bonn(波恩大学);Klinikum Braunschweig(不伦瑞克医院)
PromptHSI: Universal Hyperspectral Image Restoration with Vision-Language Modulated Frequency Adaptation
Institute of Data Science, National Cheng Kung University(成功大学数据科学研究所);Graduate Institute of Communication Engineering, National Taiwan University(台湾大学通讯工程学系);NVIDIA(英伟达公司)
Hyperspectral Image Generation with Unmixing Guided Diffusion Model
School of Statistics and Data Science, KLMDASR, LEBPS, and LPMC, Nankai University(统计与数据科学学院,KLMDASR,LEBPS和LPMC,南开大学);Image Processing Center, School of Astronautics, Beihang University(图像处理中心,航天学院,北航大学)
Scribble-Based Interactive Segmentation of Medical Hyperspectral Images
School of Biomedical Engineering & Imaging Sciences, King’s College London(伦敦国王学院生物医学工程与影像科学学院);Department of Neurosurgery, King’s College Hospital(国王学院医院神经外科);Hypervision Surgical(Hypervision Surgical公司)
mHealth hyperspectral learning for instantaneous spatiospectral imaging of hemodynamics
Weldon School of Biomedical Engineering, Purdue University(普渡大学生物医学工程学院);Regenstrief Center for Healthcare Engineering(里真斯特里夫医疗保健工程中心);Purdue Quantum Science and Engineering Institute(普渡大学量子科学与工程研究所)
Semantic segmentation of surgical hyperspectral images under geometric domain shifts
German Cancer Research Center (DKFZ)(德国癌症研究中心);Heidelberg University(海德堡大学);National Center for Tumor Diseases (NCT)(国家肿瘤疾病中心);Heidelberg University Hospital(海德堡大学医院)
Towards Lightweight Hyperspectral Image Super-Resolution with Depthwise Separable Dilated Convolutional Network
Department of Computer Science, Aalto University, Finland(艾尔沃斯大学计算机科学系);School of Electrical and Electronic Engineering, University of Sheffield, United Kingdom(谢菲尔德大学电子与电气工程学院)
Robust deep learning-based semantic organ segmentation in hyperspectral images
German Cancer Research Center (DKFZ)(德国癌症研究中心);Helmholtz Information and Data Science School for Health(亥姆霍兹健康信息与数据科学学院);Heidelberg University Hospital(海德堡大学医院);Heidelberg University(海德堡大学)
A Hyperspectral Imaging Dataset and Methodology for Intraoperative Pixel-Wise Classification of Metastatic Colon Cancer in the Liver
Ruđer Bošković Institute(鲁杰尔·博什科维奇研究所);Technical University Munich(慕尼黑工业大学);University of Montreal(蒙特利尔大学);Photon etc.(Photon etc.公司);Clinical Hospital Center Zagreb(萨格勒布临床医院中心);University of Zagreb(萨格勒布大学);Clinical Hospital Dubrava(杜布拉瓦临床医院)
Hierarchy-Aware and Channel-Adaptive Semantic Communication for Bandwidth-Limited Data Fusion
State Key Laboratory of Advanced Rail Autonomous Operation(先进轨道交通自主运行全国重点实验室);Beijing Jiaotong University(北京交通大学);School of Electronic and Information Engineering, Beijing Jiaotong University(北京交通大学电子与信息工程学院);Linköping University(林雪平大学);Singapore University of Technology and Design(新加坡科技设计大学)
A comprehensive review of 3D convolutional neural network-based classification techniques of diseased and defective crops using non-UAV-based hyperspectral images
HSIGene: A Foundation Model For Hyperspectral Image Generation
School of Mathematics and Statistics, Northwestern Polytechnical University(西北工业大学数学与统计学院);Xidian University(西安电子科技大学);Pazhou Laboratory (Huangpu)(琶洲实验室(黄埔))
Field Calibration of Hyperspectral Cameras for Terrain Inference
Electrical and Computer Engineering Department, Northeastern University(电气与计算机工程系,东北大学);Lincoln Laboratory, Massachusetts Institute of Technology(林肯实验室,麻省理工学院)
Hyperspectral Denoising Using Unsupervised Disentangled Spatio-Spectral Deep Priors
University of Electronic Science and Technology of China(电子科技大学);Oregon State University(俄勒冈州立大学);RIKEN Center for Advanced Intelligence Project(理化学研究所先进智能项目中心)