MXR-U-Nets for Real Time Hyperspectral Reconstruction

Pixxel (Numancia Aerospace Limited)（Pixxel（努曼西亚航空航天有限公司））；Workbench Projects

Atmadeep Banerjee, Akash Palrecha

英文摘要：

In recent times, CNNs have made significant contributions to applications in image generation, super-resolution and style transfer. In this paper, we build upon the work of Howard and Gugger, He et al. and Misra, D. and propose a CNN architecture that accurately reconstructs hyperspectral images from their RGB counterparts. We also propose a much shallower version of our best model with a 10% relative memory footprint and 3x faster inference, thus enabling real-time video applications while still experiencing only about a 0.5% decrease in performance.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

Cross-Attention in Coupled Unmixing Nets for Unsupervised Hyperspectral Super-Resolution

Remote Sensing Technology Institute, German Aerospace Center（德国航空航天中心遥感技术研究所）；Technical University of Munich（慕尼黑工业大学）；Univ. Grenoble Alpes, INRIA, CNRS, Grenoble INP, LJK（格勒诺布尔阿尔卑斯大学、法国国家信息与自动化研究所、法国国家科学研究中心、格勒诺布尔理工学院、LJK实验室）；Macau University of Science and Technology（澳门科技大学）

The recent advancement of deep learning techniques has made great progress on hyperspectral image super-resolution (HSI-SR). Yet the development of unsupervised deep networks remains challenging for this task. To this end, we propose a novel coupled unmixing network with a cross-attention mechanism, CUCaNet for short, to enhance the spatial resolution of HSI by means of higher-spatial-resolution multispectral image (MSI). Inspired by coupled spectral unmixing, a two-stream convolutional autoencoder framework is taken as backbone to jointly decompose MS and HS data into a spectrally meaningful …

2020-08-01cs.CVeess.IV

Naive Gabor Networks for Hyperspectral Image Classification

Sun Yat-sen University（中山大学）；South China University of Technology（华南理工大学）；Hunan University（湖南大学）；University of Extremadura（埃斯特雷马杜拉大学）；Beihang University（北京航空航天大学）

Recently, many convolutional neural network (CNN) methods have been designed for hyperspectral image (HSI) classification since CNNs are able to produce good representations of data, which greatly benefits from a huge number of parameters. However, solving such a high-dimensional optimization problem often requires a large amount of training samples in order to avoid overfitting. Additionally, it is a typical non-convex problem affected by many local minima and flat regions. To address these problems, in this paper, we introduce naive Gabor Networks or Gabor-Nets which, for the first time in t…

2020-02-24cs.CVcs.LGeess.IV

Attention Mechanism Meets with Hybrid Dense Network for Hyperspectral Image Classification

National University of Computer and Emerging Sciences（国立计算机与新兴科学大学）；Innopolis University（因诺波利斯大学）；University of Messina（墨西拿大学）；Jalpaiguri Government Engineering College（贾尔派古里政府工程学院）；Beijing Institute of Technology（北京理工大学）

Convolutional Neural Networks (CNN) are more suitable, indeed. However, fixed kernel sizes make traditional CNN too specific, neither flexible nor conducive to feature learning, thus impacting on the classification accuracy. The convolution of different kernel size networks may overcome this problem by capturing more discriminating and relevant information. In light of this, the proposed solution aims at combining the core idea of 3D and 2D Inception net with the Attention mechanism to boost the HSIC CNN performance in a hybrid scenario. The resulting \textit{attention-fused hybrid network} (A…

2022-01-04cs.CVeess.IV

Graph Neural Networks Extract High-Resolution Cultivated Land Maps from Sentinel-2 Image Series

Silesian University of Technology（西里西亚工业大学）；KP Labs（KP实验室）；European Space Agency（欧洲空间局）

Maintaining farm sustainability through optimizing the agricultural management practices helps build more planet-friendly environment. The emerging satellite missions can acquire multi- and hyperspectral imagery which captures more detailed spectral information concerning the scanned area, hence allows us to benefit from subtle spectral features during the analysis process in agricultural applications. We introduce an approach for extracting 2.5 m cultivated land maps from 10 m Sentinel-2 multispectral image series which benefits from a compact graph convolutional neural network. The experimen…

2022-08-03cs.CVcs.LGeess.IV