Three-Dimensional Fourier Scattering Transform and Classification of Hyperspectral Images
UMIACS, University of Maryland at College Park(马里兰大学帕克分校高级计算机研究所);University of Maryland at College Park(马里兰大学帕克分校);Courant Institute of Mathematical Sciences, New York University(纽约大学库朗数学科学研究所)
Ilya Kavalerov, Weilin Li, Wojciech Czaja, Rama Chellappa
备注:
Accepted to IEEE Transactions On Geoscience And Remote Sensing
Recent developments in machine learning and signal processing have resulted in many new techniques that are able to effectively capture the intrinsic yet complex properties of hyperspectral imagery. Tasks ranging from anomaly detection to classification can now be solved by taking advantage of very efficient algorithms which have their roots in representation theory and in computational approximation. Time-frequency methods are one example of such techniques. They provide means to analyze and extract the spectral content from data. On the other hand, hierarchical methods such as neural networks incorporate spatial information across scales and model multiple levels of dependencies between spectral features. Both of these approaches have recently been proven to provide significant advances in the spectral-spatial classification of hyperspectral imagery. The 3D Fourier scattering transform, which is introduced in this paper, is an amalgamation of time-frequency representations with neural network architectures. It leverages the benefits provided by the Short-Time Fourier Transform with the numerical efficiency of deep learning network structures. We test the proposed method on several standard hyperspectral datasets, and we present results that indicate that the 3D Fourier scattering transform is highly effective at representing spectral content when compared with other state-of-the-art spectral-spatial classification methods.
3D Fourier-based Global Feature Extraction for Hyperspectral Image Classification
SDAIA-KFUPM, Joint Research Center for Artificial Intelligence (JRCAI), King Fahd University of Petroleum and Minerals(SDAIA-KFUPM联合人工智能研究中心(JRCAI)、国王法赫德石油矿物大学)
EnergyFormer: Energy Attention with Fourier Embedding for Hyperspectral Image Classification
Department of Computer Science, National University of Computer and Emerging Sciences(计算机科学系,国立计算机与新兴科学大学);Institute of Software Development and Engineering, Innopolis University(软件开发与工程研究所,因诺波利斯大学);Dipartimento di Matematica e Informatica—MIFT, University of Messina(数学与信息学系—MIFT,墨西拿大学)
Pyramid Hierarchical Transformer for Hyperspectral Image Classification
National University of Computer and Emerging Sciences(国家计算机与新兴科学大学);University of Messina(墨西拿大学);Shaoxing University(绍兴大学);Innopolis University(因诺波利斯大学)
Cosine-Normalized Attention for Hyperspectral Image Classification
SDAIA-KFUPM, Joint Research Center for Artificial Intelligence (JRCAI), King Fahd University of Petroleum and Minerals(SDAIA-KFUPM联合人工智能研究中心(JRCAI),法赫德国王石油矿产大学);Institute of Software Development and Engineering, Innopolis University(软件开发和工程学院,因诺波利斯大学)
Dynamic Memory Transformer for Hyperspectral Image Classification
SDAIA-KFUPM, Joint Research Center for Artificial Intelligence (JRCAI), King Fahd University of Petroleum and Minerals(SDAIA-KFUPM联合人工智能研究中心(JRCAI)、国王法赫德石油矿物大学)
Coarse-to-Fine Sparse Transformer for Hyperspectral Image Reconstruction
Shenzhen Institute of Future Media Technology(深圳未来媒体技术研究院);Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Westlake University(西湖大学);ETH Zürich(苏黎世联邦理工学院)
Boosting Hyperspectral Image Classification with Gate-Shift-Fuse Mechanisms in a Novel CNN-Transformer Approach
University of Salento(萨伦托大学);National Research Council of Italy(意大利国家研究委员会);Universite Polytechnique Hauts de France(上法兰西理工大学);Universite de Lille(里尔大学);CNRS(法国国家科学研究中心)
Deep Hyperspectral Unmixing using Transformer Network
Jalpaiguri Engineering College(贾尔派古里工程学院);University of Antwerp(安特卫普大学);Helmholtz-Zentrum Dresden-Rossendorf(亥姆霍兹德累斯顿罗森多夫研究中心);Helmholtz Institute Freiberg for Resource Technology(亥姆霍兹弗赖贝格资源技术研究所)
目前,这篇论文正在IEEE进行评审。Transformers以其在自然语言处理方面的最先进性能引起了视觉研究界的兴趣。Transformers凭借其优越的性能,在高光谱图像分类领域找到了自己的道路,并取得了可喜的成果。在这篇文章中,我们利用Transformers的力量来克服高光谱解混的任务,并提出了一种新的深度解混模型与Transformers。我们的目标是利用Transformers的能力,以更好地捕捉全球功能的依赖关系,以提高端元光谱和丰度图的质量。所提出的模型是卷积自动编码器和Transformer的组合。高光谱数据由卷积编码器编码。Transformer捕获从编码器导出的表示之间的长范围依赖性。使用卷积解码器重建数据。我们将所提出的解混模型应用于三个广泛使用的解混数据集,即,Samson、Apex和Washington DC mall的数据,并在均方根误差和光谱角距离方面将其与最新技术进行了比较。拟议模型的源代码将在\url{https://github.com/preetam22n/DeepTrans-HSU}上公开提供。
Transformer for Multitemporal Hyperspectral Image Unmixing
College of Computer Science, Nankai University(南开大学计算机学院);Haihe Lab(海河实验室);School of Computer Science and Technology, Tiangong University(天津工业大学计算机科学与技术学院);School of Astronautics, Beihang University(北京航空航天大学宇航学院)
Benchmarking foundation models for hyperspectral image classification: Application to cereal crop type mapping
Analytics Lab (A-Lab), UM6P, Rabat 11103, Morocco(安利实验室(A-Lab));Center for Remote Sensing Applications (CRSA), UM6P, Ben Guerir 43150, Morocco(远程传感应用中心(CRSA));Friedrich Schiller University Jena, Department of Geography, Jena 07743, Germany(耶拿弗里德里希·施勒格尔大学);Dept. of Cartography(制图部门)
Grafting Transformer on Automatically Designed Convolutional Neural Network for Hyperspectral Image Classification
Northwestern Polytechnical University(西北工业大学);Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳));Shaanxi Normal University(陕西师范大学);Yan’an University(延安大学)
A Synergistic CNN-Transformer Network with Pooling Attention Fusion for Hyperspectral Image Classification
College of Engineering(工程学院);School of Electronic Information and Communications(电子信息与通信学院);Changchun Institute of Optics, Fine Mechanics and Physics(长春光学精密机械与物理研究所);School of Computer Science and Technology(计算机科学与技术学院);School of Intelligent Manufacturing and Electrical Engineering(智能制造与电气工程学院)
Invariant Attribute Profiles: A Spatial-Frequency Joint Feature Extractor for Hyperspectral Image Classification
German Aerospace Center (DLR)(德国航空航天中心);Technical University of Munich (TUM)(慕尼黑工业大学);Beijing Institute of Technology(北京理工大学);Helmholtz-Zentrum Dresden-Rossendorf(亥姆霍兹德累斯顿罗森多夫研究中心);Univ. Grenoble Alpes(格勒诺布尔阿尔卑斯大学);INRIA(法国国家信息与自动化研究所);CNRS(法国国家科学研究中心);Grenoble INP(格勒诺布尔国立高等物理、数学与信息学院)