Graph Convolutional Networks for Hyperspectral Image Classification

Abstract

To read the final version please go to IEEE TGRS on IEEE Xplore. Convolutional neural networks (CNNs) have been attracting increasing attention in hyperspectral (HS) image classification, owing to their ability to capture spatial-spectral feature representations. Nevertheless, their ability in modeling relations between samples remains limited. Beyond the limitations of grid sampling, graph convolutional networks (GCNs) have been recently proposed and successfully applied in irregular (or non-grid) data representation and analysis. In this paper, we thoroughly investigate CNNs and GCNs (qualitatively and quantitatively) in terms of HS image classification. Due to the construction of the adjacency matrix on all the data, traditional GCNs usually suffer from a huge computational cost, particularly in large-scale remote sensing (RS) problems. To this end, we develop a new mini-batch GCN (called miniGCN hereinafter) which allows to train large-scale GCNs in a mini-batch fashion. More significantly, our miniGCN is capable of inferring out-of-sample data without re-training networks and improving classification performance. Furthermore, as CNNs and GCNs can extract different types of HS features, an intuitive solution to break the performance bottleneck of a single model is to fuse them. Since miniGCNs can perform batch-wise network training (enabling the combination of CNNs and GCNs) we explore three fusion strategies: additive fusion, element-wise multiplicative fusion, and concatenation fusion to measure the obtained performance gain. Extensive experiments, conducted on three HS datasets, demonstrate the advantages of miniGCNs over GCNs and the superiority of the tested fusion strategies with regards to the single CNN or GCN models. The codes of this work will be available at https://github.com/danfenghong/IEEE_TGRS_GCN for the sake of reproducibility.

References in corpus (16)

• Adam: A Method for Stochastic Optimization
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• Semi-Supervised Classification with Graph Convolutional Networks
• Deep Learning for Hyperspectral Image Classification: An Overview
• An Augmented Linear Mixing Model to Address Spectral Variability for Hyperspectral Unmixing
• Feature Extraction for Hyperspectral Imagery: The Evolution from Shallow to Deep (Overview and Toolbox)
• Cascaded Recurrent Neural Networks for Hyperspectral Image Classification
• GraphSAINT: Graph Sampling Based Inductive Learning Method
• Invariant Attribute Profiles: A Spatial-Frequency Joint Feature Extractor for Hyperspectral Image Classification
• Learnable Manifold Alignment (LeMA) : A Semi-supervised Cross-modality Learning Framework for Land Cover and Land Use Classification
• X-ModalNet: A Semi-Supervised Deep Cross-Modal Network for Classification of Remote Sensing Data
• CoSpace: Common Subspace Learning from Hyperspectral-Multispectral Correspondences
• Spectral Superresolution of Multispectral Imagery with Joint Sparse and Low-Rank Learning
• Fourier-based Rotation-invariant Feature Boosting: An Efficient Framework for Geospatial Object Detection
• Learning Convolutional Sparse Coding on Complex Domain for Interferometric Phase Restoration
• Hyperspectral Image Classification With Context-Aware Dynamic Graph Convolutional Network

Cited by in corpus (49)

• UIU-Net: U-Net in U-Net for Infrared Small Object Detection
• Multimodal Fusion Transformer for Remote Sensing Image Classification
• Hyperspectral Image Classification-Traditional to Deep Models: A Survey for Future Prospects
• Deep Learning for UAV-based Object Detection and Tracking: A Survey
• MambaHSI: Spatial-Spectral Mamba for Hyperspectral Image Classification
• Fusformer: A Transformer-based Fusion Approach for Hyperspectral Image Super-resolution
• Remote Sensing Cross-Modal Text-Image Retrieval Based on Global and Local Information
• Multi-Content Complementation Network for Salient Object Detection in Optical Remote Sensing Images
• SpectralDiff: A Generative Framework for Hyperspectral Image Classification with Diffusion Models
• DCN-T: Dual Context Network with Transformer for Hyperspectral Image Classification
• A Comprehensive Survey for Hyperspectral Image Classification: The Evolution from Conventional to Transformers and Mamba Models
• S${}^2$Mamba: A Spatial-spectral State Space Model for Hyperspectral Image Classification
• Opening the Black-Box: A Systematic Review on Explainable AI in Remote Sensing
• NFANet: A Novel Method for Weakly Supervised Water Extraction from High-Resolution Remote Sensing Imagery
• Asymmetric Hash Code Learning for Remote Sensing Image Retrieval
• Dual-Branch Subpixel-Guided Network for Hyperspectral Image Classification
• Semantic-aware Dense Representation Learning for Remote Sensing Image Change Detection
• Diffusion Models Meet Remote Sensing: Principles, Methods, and Perspectives
• Physically-Constrained Transfer Learning through Shared Abundance Space for Hyperspectral Image Classification
• SpectralEarth: Training Hyperspectral Foundation Models at Scale
• Pyramid Hierarchical Transformer for Hyperspectral Image Classification
• SpectralFormer: Rethinking Hyperspectral Image Classification with Transformers
• A General Destriping Framework for Remote Sensing Images Using Flatness Constraint
• Deep Posterior Distribution-based Embedding for Hyperspectral Image Super-resolution
• 3D Instance Segmentation of MVS Buildings
• Style Alignment based Dynamic Observation Method for UAV-View Geo-localization
• Multi-frequency PolSAR Image Fusion Classification Based on Semantic Interactive Information and Topological Structure
• Fast Unmixing and Change Detection in Multitemporal Hyperspectral Data
• Unsupervised Diffusion and Volume Maximization-Based Clustering of Hyperspectral Images
• Transformer-Driven Inverse Problem Transform for Fast Blind Hyperspectral Image Dehazing
• Learning Interpretable Deep Disentangled Neural Networks for Hyperspectral Unmixing
• Quantum Feature-Empowered Deep Classification for Fast Mangrove Mapping
• MSR-GCN: Multi-Scale Residual Graph Convolution Networks for Human Motion Prediction
• Sharpend Cosine Similarity based Neural Network for Hyperspectral Image Classification
• Rotation Equivariant Feature Image Pyramid Network for Object Detection in Optical Remote Sensing Imagery
• Towards Cross-Disaster Building Damage Assessment with Graph Convolutional Networks
• Shallow Network Based on Depthwise Over-Parameterized Convolution for Hyperspectral Image Classification
• Distributed Learning over Networks with Graph-Attention-Based Personalization
• Triplet-Watershed for Hyperspectral Image Classification
• Automatic Extraction of Road Networks by using Teacher-Student Adaptive Structural Deep Belief Network and Its Application to Landslide Disaster
• On Creating Benchmark Dataset for Aerial Image Interpretation: Reviews, Guidances and Million-AID
• Semi-supervised Hyperspectral Image Classification with Graph Clustering Convolutional Networks
• Diffusion Models for Hyperspectral Image Analysis: A Comprehensive Review
• A Deep Learning Approach Based on Graphs to Detect Plantation Lines
• Importance of Disjoint Sampling in Conventional and Transformer Models for Hyperspectral Image Classification
• Multi-patch Feature Pyramid Network for Weakly Supervised Object Detection in Optical Remote Sensing Images
• Hyperspectral Image Segmentation based on Graph Processing over Multilayer Networks
• MSHCNet: Multi-Stream Hybridized Convolutional Networks with Mixed Statistics in Euclidean/Non-Euclidean Spaces and Its Application to Hyperspectral Image Classification
• Hyperspectral Remote Sensing Image Classification Based on Multi-scale Cross Graphic Convolution