A recently designed hyperspectral imaging device enables multiplexed acquisition of an entire data volume in a single snapshot thanks to monolithically-integrated spectral filters. Such an agile imaging technique comes at the cost of a reduced spatial resolution and the need for a demosaicing procedure on its interleaved data. In this work, we address both issues and propose an approach inspired by recent developments in compressed sensing and analysis sparse models. We formulate our superresolution and demosaicing task as a 3-D generalized inpainting problem. Interestingly, the target spatial resolution can be adjusted for mitigating the compression level of our sensing. The reconstruction procedure uses a fast greedy method called Pseudo-inverse IHT. We also show on simulations that a random arrangement of the spectral filters on the sensor is preferable to regular mosaic layout as it improves the quality of the reconstruction. The efficiency of our technique is demonstrated through numerical experiments on both synthetic and real data as acquired by the snapshot imager.
Band selection in RKHS for fast nonlinear unmixing of hyperspectral images
Federal University of Santa Catarina（圣卡塔琳娜联邦大学）；Université de Nice Sophia-Antipolis（尼斯索菲亚-安蒂波利斯大学）；CNRS（法国国家科学研究中心）；University of Toulouse（图卢兹大学）；IRIT-ENSEEIHT
Non-local Meets Global: An Iterative Paradigm for Hyperspectral Image Restoration
RIKEN Center for Advanced Intelligence Project (AIP)（理化学研究所先进智能项目中心）；Department of Electronic Engineering, Tsinghua University（清华大学电子工程系）；Paradigm Inc.（第四范式有限公司）；Graduate School of Frontier Sciences, The University of Tokyo（东京大学前沿科学研究生院）；LISMARS, Wuhan University（武汉大学测绘遥感信息工程国家重点实验室）
SLIMBRAIN: Augmented Reality Real-Time Acquisition and Processing System For Hyperspectral Classification Mapping with Depth Information for In-Vivo Surgical Procedures
Research Center on Software Technologies and Multimedia Systems, Universidad Politécnica de Madrid（马德里理工大学软件技术与多媒体系统研究中心）；Department of Neurosurgery, Hospital Universitario 12 de Octubre, Universidad Complutense de Madrid（马德里康普顿斯大学十月十二日大学医院神经外科）
Coarse-to-fine Task-driven Inpainting for Geoscience Images
Cleveland State University（克利夫兰州立大学）；Nanyang Technological University（南洋理工大学）；Wuhan University（武汉大学）；Beijing University of Technology（北京工业大学）；Brookhaven National Laboratory（布鲁克海文国家实验室）
Geometric Constraints Enable Self-Supervised Sinogram Inpainting in Sparse-View Tomography
Friedrich-Alexander-Universität Erlangen-Nürnberg（埃尔朗根-纽伦堡弗里德里希-亚历山大大学）；Fraunhofer Institute for Ceramic Technologies and Systems IKTS（弗劳恩霍夫陶瓷技术与系统研究所（IKTS））；Fraunhofer Development Center X-Ray Technology EZRT（弗劳恩霍夫X射线技术开发中心（EZRT））
X-RAFT: Cross-Modal Non-Rigid Registration of Blue and White Light Neurosurgical Hyperspectral Images
Department of Surgical \& Interventional Engineering, School of Biomedical Engineering \& Imaging Sciences, King's College London, London SE1 7EH Department of Neurosurgery, King's College London Hospital NHS Foundation Trust, London SE5 9RS, UK. Department of Imaging Chemistry \& Biology, School of Biomedical Engineering \& Imaging Sciences, King's College London, London SE1 7EH, UK.
SWAN: Self-supervised Wavelet Neural Network for Hyperspectral Image Unmixing
Info Edge India Ltd；Department of Artificial Intelligence and Machine Learning（人工智能与机器学习系）；Acharya Institute of Technology（阿查里亚理工学院）；Indian Institute of Information Technology Vadodara (IIITV)（瓦多拉印度信息科技学院）
A Saliency-Guided Street View Image Inpainting Framework for Efficient Last-Meters Wayfinding
West Virginia University（西弗吉尼亚大学）；University at Buffalo, State University of New York（纽约州立大学布法罗分校）；The Hong Kong University of Science and Technology（香港科技大学）
Physically-Constrained Transfer Learning through Shared Abundance Space for Hyperspectral Image Classification
University of Tennessee, Knoxville（田纳西大学诺克斯维尔分校）；Beijing Institute of Technology（北京理工大学）；Aerospace Information Research Institute, Chinese Academy of Sciences（中国科学院空天信息创新研究院）
Inter and Intra Prior Learning-based Hyperspectral Image Reconstruction Using Snapshot SWIR Metasurface
School of Automation, Northwestern Polytechnical University（西北工业大学自动化学院）；College of Information and Control Engineering, Xi’an University of Architecture and Technology（西安建筑科技大学信息与控制工程学院）；Sejong University（世宗大学）
LUM-ViT: Learnable Under-sampling Mask Vision Transformer for Bandwidth Limited Optical Signal Acquisition
College of Information Science & Electronic Engineering, Zhejiang University（浙江大学信息科学与电子工程学院）；College of Control Science and Engineering, Zhejiang University（浙江大学控制科学与工程学院）
Correntropy Maximization via ADMM - Application to Robust Hyperspectral Unmixing
Institut Charles Delaunay (CNRS), Université de Technologie de Troyes（特鲁瓦技术大学，夏尔·德洛内研究所（法国国家科学研究中心））；School of Engineering and Physical Sciences, Heriot-Watt University（赫瑞瓦特大学，工程与物理科学学院）；LITIS lab, Université de Rouen（鲁昂大学，LITIS实验室）
A Multisensor Hyperspectral Benchmark Dataset For Unmixing of Intimate Mixtures
University of Antwerp（安特卫普大学）；Helmholtz-Zentrum Dresden-Rossendorf（亥姆霍兹德累斯顿罗森多夫研究中心）；Helmholtz Institute Freiberg for Resource Technology（亥姆霍兹弗赖贝格资源技术研究所）
Southeast University（东南大学）；University of Tokyo（东京大学）；Chinese Academy of Sciences（中国科学院）；University of New South Wales（新南威尔士大学）；University of Extremadura（埃斯特雷马杜拉大学）；University of Pavia（帕维亚大学）；University of Iceland（冰岛大学）；Univ. Grenoble Alpes（格勒诺布尔阿尔卑斯大学）
A TRPCA-Inspired Deep Unfolding Network for Hyperspectral Image Denoising via Thresholded t-SVD and Top-K Sparse Transformer
College of Computer Science and Engineering, Shandong University of Science and Technology（计算机科学与工程学院，山东科技大学）；Gosci Information Technology Co.,Ltd.（Gosci信息技术有限公司）
Scribble-Based Interactive Segmentation of Medical Hyperspectral Images
School of Biomedical Engineering & Imaging Sciences, King’s College London（伦敦国王学院生物医学工程与影像科学学院）；Department of Neurosurgery, King’s College Hospital（国王学院医院神经外科）；Hypervision Surgical（Hypervision Surgical公司）
HIR-Diff: Unsupervised Hyperspectral Image Restoration Via Improved Diffusion Models
School of Computer Science and Technology, Xi’an Jiaotong University（西安交通大学计算机科学与技术学院）；School of Mathematics and Statistics, Xi’an Jiaotong University（西安交通大学数学与统计学院）
Hyperspectral and multispectral image fusion under spectrally varying spatial blurs -- Application to high dimensional infrared astronomical imaging
University of Toulouse（图卢兹大学）；IRIT/INP-ENSEEIHT（图卢兹计算机研究所/国立图卢兹应用科学学院-国立高等电力技术、电子学、计算机、水力学与电信学院）；CNRS（法国国家科学研究中心）；Institut Universitaire de France (IUF)（法国大学研究院）；ISAE-SUPAERO（法国高等航空航天学院）；Institut de Recherche en Astrophysique et Planétologie (IRAP)（天体物理与行星学研究所）
Physics-Informed Untrained Learning for RGB-Guided Superresolution Single-Pixel Hyperspectral Imaging
College of Science, Northwest Agriculture & Forestry University（西北农林科技大学理学院）；Key Laboratory of Photoelectronic Imaging Technology and System, School of Optics and Photonics, Beijing Institute of Technology（北京理工大学光电学院光电成像技术与系统教育部重点实验室）；State Key Laboratory of Digital Manufacturing Equipment and Technology, Huazhong University of Science and Technology（华中科技大学数字制造装备与技术国家重点实验室）
In-Vivo Hyperspectral Human Brain Image Database for Brain Cancer Detection
University of Las Palmas de Gran Canaria（大加那利岛拉斯帕尔马斯大学）；University Hospital Doctor Negrin（内格林大学医院）；University Hospital Southampton（南安普顿大学医院）；Addenbrookes Hospital（阿登布鲁克医院）；University of Cambridge（剑桥大学）；AKKA Technologies（AKKA Technologies公司）；Imperial College London（伦敦帝国理工学院）；Universidad Politécnica de Madrid（马德里理工大学）；Ecole Nationale Supérieure des Mines de Paris（巴黎高等矿业学校）；MINES ParisTech（巴黎矿业学院）
