Spectral Superresolution of Multispectral Imagery with Joint Sparse and Low-Rank Learning

Abstract

Extensive attention has been widely paid to enhance the spatial resolution of hyperspectral (HS) images with the aid of multispectral (MS) images in remote sensing. However, the ability in the fusion of HS and MS images remains to be improved, particularly in large-scale scenes, due to the limited acquisition of HS images. Alternatively, we super-resolve MS images in the spectral domain by the means of partially overlapped HS images, yielding a novel and promising topic: spectral superresolution (SSR) of MS imagery. This is challenging and less investigated task due to its high ill-posedness in inverse imaging. To this end, we develop a simple but effective method, called joint sparse and low-rank learning (J-SLoL), to spectrally enhance MS images by jointly learning low-rank HS-MS dictionary pairs from overlapped regions. J-SLoL infers and recovers the unknown hyperspectral signals over a larger coverage by sparse coding on the learned dictionary pair. Furthermore, we validate the SSR performance on three HS-MS datasets (two for classification and one for unmixing) in terms of reconstruction, classification, and unmixing by comparing with several existing state-of-the-art baselines, showing the effectiveness and superiority of the proposed J-SLoL algorithm. Furthermore, the codes and datasets will be available at: https://github.com/danfenghong/IEEE\_TGRS\_J-SLoL, contributing to the RS community.

References in corpus (16)

• Robust Recovery of Subspace Structures by Low-Rank Representation
• An Augmented Linear Mixing Model to Address Spectral Variability for Hyperspectral Unmixing
• Hyperspectral and Multispectral Image Fusion based on a Sparse Representation
• Feature Extraction for Hyperspectral Imagery: The Evolution from Shallow to Deep (Overview and Toolbox)
• Cascaded Recurrent Neural Networks for Hyperspectral Image Classification
• Classification of Hyperspectral and LiDAR Data Using Coupled CNNs
• An Alternating Direction Algorithm for Matrix Completion with Nonnegative Factors
• Invariant Attribute Profiles: A Spatial-Frequency Joint Feature Extractor for Hyperspectral Image Classification
• Learnable Manifold Alignment (LeMA) : A Semi-supervised Cross-modality Learning Framework for Land Cover and Land Use Classification
• CoSpace: Common Subspace Learning from Hyperspectral-Multispectral Correspondences
• ORSIm Detector: A Novel Object Detection Framework in Optical Remote Sensing Imagery Using Spatial-Frequency Channel Features
• Fourier-based Rotation-invariant Feature Boosting: An Efficient Framework for Geospatial Object Detection
• MIMA: MAPPER-Induced Manifold Alignment for Semi-Supervised Fusion of Optical Image and Polarimetric SAR Data
• Learning Convolutional Sparse Coding on Complex Domain for Interferometric Phase Restoration
• Learning Shared Cross-modality Representation Using Multispectral-LiDAR and Hyperspectral Data
• An efficient CNN for spectral reconstruction from RGB images

Cited by in corpus (3)

• Graph Convolutional Networks for Hyperspectral Image Classification
• Multi-Resolution Data Fusion for Super Resolution Imaging
• Shallow Network Based on Depthwise Over-Parameterized Convolution for Hyperspectral Image Classification