A Comprehensive Survey for Hyperspectral Image Classification: The Evolution from Conventional to Transformers and Mamba Models

Abstract

Hyperspectral Image Classification (HSC) presents significant challenges owing to the high dimensionality and intricate nature of Hyperspectral (HS) data. While traditional Machine Learning (TML) approaches have demonstrated effectiveness, they often encounter substantial obstacles in real-world applications, including the variability of optimal feature sets, subjectivity in human-driven design, inherent biases, and methodological limitations. Specifically, TML suffers from the curse of dimensionality, difficulties in feature selection and extraction, insufficient consideration of spatial information, limited robustness against noise, scalability issues, and inadequate adaptability to complex data distributions. In recent years, Deep Learning (DL) techniques have emerged as robust solutions to address these challenges. This survey offers a comprehensive overview of current trends and future prospects in HSC, emphasizing advancements from DL models to the increasing adoption of Transformer and Mamba Model architectures. We systematically review key concepts, methodologies, and state-of-the-art approaches in DL for HSC. Furthermore, we investigate the potential of Transformer-based models and the Mamba Model in HSC, detailing their advantages and challenges. Emerging trends in HSC are explored, including in-depth discussions on Explainable AI and Interoperability concepts, alongside Diffusion Models for image denoising, feature extraction, and image fusion. Comprehensive experimental results were conducted on three HS datasets to substantiate the efficacy of various conventional DL models and Transformers. Additionally, we identify several open challenges and pertinent research questions in the field of HSC. Finally, we outline future research directions and potential applications aimed at enhancing the accuracy and efficiency of HSC.

References in corpus (27)

• Deep Learning for Hyperspectral Image Classification: An Overview
• Graph Convolutional Networks for Hyperspectral Image Classification
• UIU-Net: U-Net in U-Net for Infrared Small Object Detection
• An Augmented Linear Mixing Model to Address Spectral Variability for Hyperspectral Unmixing
• SpectralGPT: Spectral Remote Sensing Foundation Model
• Cascaded Recurrent Neural Networks for Hyperspectral Image Classification
• Hyperspectral Image Classification-Traditional to Deep Models: A Survey for Future Prospects
• Learnable Manifold Alignment (LeMA) : A Semi-supervised Cross-modality Learning Framework for Land Cover and Land Use Classification
• X-ModalNet: A Semi-Supervised Deep Cross-Modal Network for Classification of Remote Sensing Data
• Hyperspectral Classification Based on Lightweight 3-D-CNN With Transfer Learning
• CoSpace: Common Subspace Learning from Hyperspectral-Multispectral Correspondences
• ORSIm Detector: A Novel Object Detection Framework in Optical Remote Sensing Imagery Using Spatial-Frequency Channel Features
• Active Transfer Learning Network: A Unified Deep Joint Spectral-Spatial Feature Learning Model For Hyperspectral Image Classification
• Deep Hyperspectral Unmixing using Transformer Network
• Generative Adversarial Networks and Conditional Random Fields for Hyperspectral Image Classification
• Fourier-based Rotation-invariant Feature Boosting: An Efficient Framework for Geospatial Object Detection
• On the Sampling Strategy for Evaluation of Spectral-spatial Methods in Hyperspectral Image Classification
• Land Cover Classification from Multi-temporal, Multi-spectral Remotely Sensed Imagery using Patch-Based Recurrent Neural Networks
• SpectralDiff: A Generative Framework for Hyperspectral Image Classification with Diffusion Models
• Spatial and Spatial-Spectral Morphological Mamba for Hyperspectral Image Classification
• WaveMamba: Spatial-Spectral Wavelet Mamba for Hyperspectral Image Classification
• Video-rate multispectral imaging in laparoscopic surgery: First-in-human application
• Pyramid Hierarchical Transformer for Hyperspectral Image Classification
• Hyperspectral Image Denoising Using Non-convex Local Low-rank and Sparse Separation with Spatial-Spectral Total Variation Regularization
• Multi-head Spatial-Spectral Mamba for Hyperspectral Image Classification
• Multi-scale Diffusion Denoised Smoothing
• B-cos Alignment for Inherently Interpretable CNNs and Vision Transformers

Cited by in corpus (1)

• EnergyFormer: Energy Attention with Fourier Embedding for Hyperspectral Image Classification