Deep Learning for Hyperspectral Image Classification: An Overview

Abstract

Hyperspectral image (HSI) classification has become a hot topic in the field of remote sensing. In general, the complex characteristics of hyperspectral data make the accurate classification of such data challenging for traditional machine learning methods. In addition, hyperspectral imaging often deals with an inherently nonlinear relation between the captured spectral information and the corresponding materials. In recent years, deep learning has been recognized as a powerful feature-extraction tool to effectively address nonlinear problems and widely used in a number of image processing tasks. Motivated by those successful applications, deep learning has also been introduced to classify HSIs and demonstrated good performance. This survey paper presents a systematic review of deep learning-based HSI classification literatures and compares several strategies for this topic. Specifically, we first summarize the main challenges of HSI classification which cannot be effectively overcome by traditional machine learning methods, and also introduce the advantages of deep learning to handle these problems. Then, we build a framework which divides the corresponding works into spectral-feature networks, spatial-feature networks, and spectral-spatial-feature networks to systematically review the recent achievements in deep learning-based HSI classification. In addition, considering the fact that available training samples in the remote sensing field are usually very limited and training deep networks require a large number of samples, we include some strategies to improve classification performance, which can provide some guidelines for future studies on this topic. Finally, several representative deep learning-based classification methods are conducted on real HSIs in our experiments.

References in corpus (7)

• Deep learning in remote sensing: a review
• Going Deeper with Contextual CNN for Hyperspectral Image Classification
• Three dimensional Deep Learning approach for remote sensing image classification
• Unsupervised Deep Feature Extraction for Remote Sensing Image Classification
• Cascaded Recurrent Neural Networks for Hyperspectral Image Classification
• Hyperspectral Image Classification with Markov Random Fields and a Convolutional Neural Network
• BASS Net: Band-Adaptive Spectral-Spatial Feature Learning Neural Network for Hyperspectral Image Classification

Cited by in corpus (42)

• Graph Convolutional Networks for Hyperspectral Image Classification
• More Diverse Means Better: Multimodal Deep Learning Meets Remote Sensing Imagery Classification
• Remote Sensing Image Scene Classification Meets Deep Learning: Challenges, Methods, Benchmarks, and Opportunities
• Feature Extraction for Hyperspectral Imagery: The Evolution from Shallow to Deep (Overview and Toolbox)
• A Review on Deep Learning in UAV Remote Sensing
• Hyperspectral Image Classification-Traditional to Deep Models: A Survey for Future Prospects
• RSVQA: Visual Question Answering for Remote Sensing Data
• Machine Learning Information Fusion in Earth Observation: A Comprehensive Review of Methods, Applications and Data Sources
• A broadband hyperspectral image sensor with high spatio-temporal resolution
• Spatial-Spectral Feature Extraction via Deep ConvLSTM Neural Networks for Hyperspectral Image Classification
• FPGA: Fast Patch-Free Global Learning Framework for Fully End-to-End Hyperspectral Image Classification
• Graph Convolutional Subspace Clustering: A Robust Subspace Clustering Framework for Hyperspectral Image
• Spectral-Spatial Mamba for Hyperspectral Image Classification
• Fusion of Dual Spatial Information for Hyperspectral Image Classification
• Deep Reinforcement Learning for Band Selection in Hyperspectral Image Classification
• SpectralDiff: A Generative Framework for Hyperspectral Image Classification with Diffusion Models
• A Comprehensive Survey for Hyperspectral Image Classification: The Evolution from Conventional to Transformers and Mamba Models
• Optical Remote Sensing Image Understanding with Weak Supervision: Concepts, Methods, and Perspectives
• S${}^2$Mamba: A Spatial-spectral State Space Model for Hyperspectral Image Classification
• Asymmetric Hash Code Learning for Remote Sensing Image Retrieval
• Dual-Branch Subpixel-Guided Network for Hyperspectral Image Classification
• AeroRIT: A New Scene for Hyperspectral Image Analysis
• Diffusion Models Meet Remote Sensing: Principles, Methods, and Perspectives
• Deep Blind Super-Resolution for Satellite Video
• Hyperspectral Pansharpening: Critical Review, Tools and Future Perspectives
• Physically-Constrained Transfer Learning through Shared Abundance Space for Hyperspectral Image Classification
• FedFusion: Manifold Driven Federated Learning for Multi-satellite and Multi-modality Fusion
• SpectralFormer: Rethinking Hyperspectral Image Classification with Transformers
• A fast and Accurate Similarity-constrained Subspace Clustering Framework for Unsupervised Hyperspectral Image Classification
• 3DGAUnet: 3D generative adversarial networks with a 3D U-Net based generator to achieve the accurate and effective synthesis of clinical tumor image data for pancreatic cancer
• Tinto: Multisensor Benchmark for 3D Hyperspectral Point Cloud Segmentation in the Geosciences
• Spatial Gated Multi-Layer Perceptron for Land Use and Land Cover Mapping
• Sharpend Cosine Similarity based Neural Network for Hyperspectral Image Classification
• Triplet-Watershed for Hyperspectral Image Classification
• Variational Tensor Neural Networks for Deep Learning
• Feature Fusion via Dual-resolution Compressive Measurement Matrix Analysis For Spectral Image Classification
• Learning to Recover Spectral Reflectance from RGB Images
• Terrain Classification using Transfer Learning on Hyperspectral Images: A Comparative study
• Diffusion Models for Hyperspectral Image Analysis: A Comprehensive Review
• Bidirectional recurrent imputation and abundance estimation of LULC classes with MODIS multispectral time series and geo-topographic and climatic data
• HyperColorization: Propagating spatially sparse noisy spectral clues for reconstructing hyperspectral images
• Data Efficient Complex Feature Fusion Network For Hyperspectral Image Classification