首页/论文/2011.09701

arXiv 2011.097012020-11eess.IVcs.CV

Spectral Response Function Guided Deep Optimization-driven Network for Spectral Super-resolution

Jiang He, Jie Li, Qiangqiang Yuan, Huanfeng Shen, Liangpei Zhang

英文摘要：

Hyperspectral images are crucial for many research works. Spectral super-resolution (SSR) is a method used to obtain high spatial resolution (HR) hyperspectral images from HR multispectral images. Traditional SSR methods include model-driven algorithms and deep learning. By unfolding a variational method, this paper proposes an optimization-driven convolutional neural network (CNN) with a deep spatial-spectral prior, resulting in physically interpretable networks. Unlike the fully data-driven CNN, auxiliary spectral response function (SRF) is utilized to guide CNNs to group the bands with spectral relevance. In addition, the channel attention module (CAM) and reformulated spectral angle mapper loss function are applied to achieve an effective reconstruction model. Finally, experiments on two types of datasets, including natural and remote sensing images, demonstrate the spectral enhancement effect of the proposed method. And the classification results on the remote sensing dataset also verified the validity of the information enhanced by the proposed method.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

LG-PF：轻量级置信度引导的偏振图像融合

LG-PF: Lightweight Confidence-Guided Polarization Image Fusion

Foshan University（佛山大学）；North University of China（中北大学）

针对偏振图像融合中DoLP可靠性差异问题，提出轻量级置信度引导框架LG-PF，通过置信度先验、掩码多尺度融合和校正头实现选择性残差传递，在MSP数据集上六项指标最优，且参数少、推理快。

2026-09-22cs.CV

PAG-Net: Progressive Attention Guided Depth Super-resolution Network

Indian Institute of Technology Kharagpur（印度理工学院卡拉格普尔分校）

In this paper, we propose a novel method for the challenging problem of guided depth map super-resolution, called PAGNet. It is based on residual dense networks and involves the attention mechanism to suppress the texture copying problem arises due to improper guidance by RGB images. The attention module mainly involves providing the spatial attention to guidance image based on the depth features. We evaluate the proposed trained models on test dataset and provide comparisons with the state-of-the-art depth super-resolution methods.

2019-11-22cs.CV

Joint Implicit Image Function for Guided Depth Super-Resolution

Peking University（北京大学）

Guided depth super-resolution is a practical task where a low-resolution and noisy input depth map is restored to a high-resolution version, with the help of a high-resolution RGB guide image. Existing methods usually view this task as a generalized guided filtering problem that relies on designing explicit filters and objective functions, or a dense regression problem that directly predicts the target image via deep neural networks. These methods suffer from either model capability or interpretability. Inspired by the recent progress in implicit neural representation, we propose to formulate …

2021-07-23cs.CV

文本引导的可探索图像超分辨率

Text-guided Explorable Image Super-resolution

Institute for Vision and Graphics, University of Siegen（锡根大学视觉与图形研究所）

研究零样本文本引导的开放域图像超分辨率，通过修改 T2I 扩散生成过程并引入语言引导，在大下采样因子下生成语义准确、数据一致且多样可探索的复原结果。

2024-03-02cs.CV

Guided Depth Super-Resolution by Deep Anisotropic Diffusion

ETH Zurich（苏黎世联邦理工学院）

Performing super-resolution of a depth image using the guidance from an RGB image is a problem that concerns several fields, such as robotics, medical imaging, and remote sensing. While deep learning methods have achieved good results in this problem, recent work highlighted the value of combining modern methods with more formal frameworks. In this work, we propose a novel approach which combines guided anisotropic diffusion with a deep convolutional network and advances the state of the art for guided depth super-resolution. The edge transferring/enhancing properties of the diffusion are boos…

2023-03-28cs.AIcs.CV

ProSR：语义原型引导的离散建模用于物理一致性SAR超分辨率

ProSR: Semantic-Prototype-Guided Discrete Modeling for Physically Consistent SAR Super-Resolution

Korea Advanced Institute of Science and Technology（韩国科学技术院）

针对现有SAR超分辨率模型难以保留物理特性的问题，提出ProSR模型，通过语义引导的离散令牌预测等技术，在Umbra数据集上实现了兼顾视觉质量与散射特性的超分辨率效果。

2026-09-03cs.CV

更多相关论文收起更多论文

Pyramidal Edge-maps and Attention based Guided Thermal Super-resolution

Computational Imaging Lab, IIT Madras（印度理工学院马德拉斯分校计算成像实验室）

Guided super-resolution (GSR) of thermal images using visible range images is challenging because of the difference in the spectral-range between the images. This in turn means that there is significant texture-mismatch between the images, which manifests as blur and ghosting artifacts in the super-resolved thermal image. To tackle this, we propose a novel algorithm for GSR based on pyramidal edge-maps extracted from the visible image. Our proposed network has two sub-networks. The first sub-network super-resolves the low-resolution thermal image while the second obtains edge-maps from the vis…

2020-09-30cs.CV

放射组学引导的多模态自注意力网络用于乳腺MRI病理完全缓解预测

Radiomics-guided Multimodal Self-attention Network for Predicting Pathological Complete Response in Breast MRI

Sungkyunkwan University（成均馆大学）；Institute for Basic Science（基础科学研究院）

本文提出一种放射组学引导的多模态自注意力网络，融合DCE MRI和ADC图像特征预测乳腺癌患者病理完全缓解，实验证明其性能优于基线方法。

2024-06-05cs.CVeess.IV

磁共振delta影像组学用于追踪接受立体定向MRI引导放疗的肺部肿瘤的放射反应

Magnetic resonance delta radiomics to track radiation response in lung tumors receiving stereotactic MRI-guided radiotherapy

Mass General Brigham（麻省总医院布里格姆医疗系统）；Harvard Medical School（哈佛医学院）；Dana-Farber Cancer Institute（丹娜-法伯癌症研究所）；Harvard T.H. Chan School of Public Health（哈佛大学陈曾熙公共卫生学院）；Maastricht University（马斯特里赫特大学）

本研究通过回顾性分析47次MR引导肺部SBRT治疗，验证了delta影像组学的可行性与稳定性，发现偏度等特征可追踪放射剂量反应并与局部复发相关，为个体化放疗剂量调整提供依据。

2024-02-23cs.CVeess.IVphysics.med-ph

Cross-modal Learning for Image-Guided Point Cloud Shape Completion

Politecnico di Torino（都灵理工大学）

In this paper we explore the recent topic of point cloud completion, guided by an auxiliary image. We show how it is possible to effectively combine the information from the two modalities in a localized latent space, thus avoiding the need for complex point cloud reconstruction methods from single views used by the state-of-the-art. We also investigate a novel weakly-supervised setting where the auxiliary image provides a supervisory signal to the training process by using a differentiable renderer on the completed point cloud to measure fidelity in the image space. Experiments show significa…

2022-09-20cs.CVeess.IV

Improved Supervised Training of Physics-Guided Deep Learning Image Reconstruction with Multi-Masking

University of Minnesota（明尼苏达大学）

Physics-guided deep learning (PG-DL) via algorithm unrolling has received significant interest for improved image reconstruction, including MRI applications. These methods unroll an iterative optimization algorithm into a series of regularizer and data consistency units. The unrolled networks are typically trained end-to-end using a supervised approach. Current supervised PG-DL approaches use all of the available sub-sampled measurements in their data consistency units. Thus, the network learns to fit the rest of the measurements. In this study, we propose to improve the performance and robust…

2020-10-26cs.CVcs.LGeess.IV

Self-Supervised Learning of Physics-Guided Reconstruction Neural Networks without Fully-Sampled Reference Data

University of Minnesota（明尼苏达大学）；Center for Magnetic Resonance Research（磁共振研究中心）

Purpose: To develop a strategy for training a physics-guided MRI reconstruction neural network without a database of fully-sampled datasets. Theory and Methods: Self-supervised learning via data under-sampling (SSDU) for physics-guided deep learning (DL) reconstruction partitions available measurements into two disjoint sets, one of which is used in the data consistency units in the unrolled network and the other is used to define the loss for training. The proposed training without fully-sampled data is compared to fully-supervised training with ground-truth data, as well as conventional comp…

2020-04-14cs.CVcs.LGeess.IV