CoSpace: Common Subspace Learning from Hyperspectral-Multispectral Correspondences

Abstract

With a large amount of open satellite multispectral imagery (e.g., Sentinel-2 and Landsat-8), considerable attention has been paid to global multispectral land cover classification. However, its limited spectral information hinders further improving the classification performance. Hyperspectral imaging enables discrimination between spectrally similar classes but its swath width from space is narrow compared to multispectral ones. To achieve accurate land cover classification over a large coverage, we propose a cross-modality feature learning framework, called common subspace learning (CoSpace), by jointly considering subspace learning and supervised classification. By locally aligning the manifold structure of the two modalities, CoSpace linearly learns a shared latent subspace from hyperspectral-multispectral(HS-MS) correspondences. The multispectral out-of-samples can be then projected into the subspace, which are expected to take advantages of rich spectral information of the corresponding hyperspectral data used for learning, and thus leads to a better classification. Extensive experiments on two simulated HSMS datasets (University of Houston and Chikusei), where HS-MS data sets have trade-offs between coverage and spectral resolution, are performed to demonstrate the superiority and effectiveness of the proposed method in comparison with previous state-of-the-art methods.

References in corpus (1)

• Semisupervised Manifold Alignment of Multimodal Remote Sensing Images

Cited by in corpus (22)

• Graph Convolutional Networks for Hyperspectral Image Classification
• More Diverse Means Better: Multimodal Deep Learning Meets Remote Sensing Imagery Classification
• Feature Extraction for Hyperspectral Imagery: The Evolution from Shallow to Deep (Overview and Toolbox)
• Classification of Hyperspectral and LiDAR Data Using Coupled CNNs
• Hyperspectral Image Classification-Traditional to Deep Models: A Survey for Future Prospects
• Deep Learning for UAV-based Object Detection and Tracking: A Survey
• Invariant Attribute Profiles: A Spatial-Frequency Joint Feature Extractor for Hyperspectral Image Classification
• X-ModalNet: A Semi-Supervised Deep Cross-Modal Network for Classification of Remote Sensing Data
• Spectral Superresolution of Multispectral Imagery with Joint Sparse and Low-Rank Learning
• Polarimetric SAR Image Semantic Segmentation with 3D Discrete Wavelet Transform and Markov Random Field
• Pansharpening by convolutional neural networks in the full resolution framework
• A Comprehensive Survey for Hyperspectral Image Classification: The Evolution from Conventional to Transformers and Mamba Models
• A framework for large-scale mapping of human settlement extent from Sentinel-2 images via fully convolutional neural networks
• MIMA: MAPPER-Induced Manifold Alignment for Semi-Supervised Fusion of Optical Image and Polarimetric SAR Data
• Learning Convolutional Sparse Coding on Complex Domain for Interferometric Phase Restoration
• Learning Shared Cross-modality Representation Using Multispectral-LiDAR and Hyperspectral Data
• Vehicle Detection of Multi-source Remote Sensing Data Using Active Fine-tuning Network
• Full-resolution quality assessment for pansharpening
• Multipass SAR Interferometry Based on Total Variation Regularized Robust Low Rank Tensor Decomposition
• Shared Manifold Learning Using a Triplet Network for Multiple Sensor Translation and Fusion with Missing Data
• Triplet-Watershed for Hyperspectral Image Classification
• Multi-modal Co-learning for Earth Observation: Enhancing single-modality models via modality collaboration