Content-driven Magnitude-Derivative Spectrum Complementary Learning for Hyperspectral Image Classification

Abstract

Extracting discriminative information from complex spectral details in hyperspectral image (HSI) for HSI classification is pivotal. While current prevailing methods rely on spectral magnitude features, they could cause confusion in certain classes, resulting in misclassification and decreased accuracy. We find that the derivative spectrum proves more adept at capturing concealed information, thereby offering a distinct advantage in separating these confusion classes. Leveraging the complementarity between spectral magnitude and derivative features, we propose a Content-driven Spectrum Complementary Network based on Magnitude-Derivative Dual Encoder, employing these two features as combined inputs. To fully utilize their complementary information, we raise a Content-adaptive Point-wise Fusion Module, enabling adaptive fusion of dual-encoder features in a point-wise selective manner, contingent upon feature representation. To preserve a rich source of complementary information while extracting more distinguishable features, we introduce a Hybrid Disparity-enhancing Loss that enhances the differential expression of the features from the two branches and increases the inter-class distance. As a result, our method achieves state-of-the-art results on the extensive WHU-OHS dataset and eight other benchmark datasets.

accepted by TGRS

References in corpus (10)

• Adam: A Method for Stochastic Optimization
• Representation Learning with Contrastive Predictive Coding
• An Augmented Linear Mixing Model to Address Spectral Variability for Hyperspectral Unmixing
• SpectralGPT: Spectral Remote Sensing Foundation Model
• FPGA: Fast Patch-Free Global Learning Framework for Fully End-to-End Hyperspectral Image Classification
• A Spectral-Spatial-Dependent Global Learning Framework for Insufficient and Imbalanced Hyperspectral Image Classification
• Efficient Deep Learning of Non-local Features for Hyperspectral Image Classification
• Spectral-wise Implicit Neural Representation for Hyperspectral Image Reconstruction
• Spectrum-driven Mixed-frequency Network for Hyperspectral Salient Object Detection
• RDFNet: Regional Dynamic FISTA-Net for Spectral Snapshot Compressive Imaging

Cited by in corpus (1)

• Hyperspectral Remote Sensing Images Salient Object Detection: The First Benchmark Dataset and Baseline