Hyperspectral and Multispectral Image Fusion based on a Sparse Representation

Abstract

This paper presents a variational based approach to fusing hyperspectral and multispectral images. The fusion process is formulated as an inverse problem whose solution is the target image assumed to live in a much lower dimensional subspace. A sparse regularization term is carefully designed, relying on a decomposition of the scene on a set of dictionaries. The dictionary atoms and the corresponding supports of active coding coefficients are learned from the observed images. Then, conditionally on these dictionaries and supports, the fusion problem is solved via alternating optimization with respect to the target image (using the alternating direction method of multipliers) and the coding coefficients. Simulation results demonstrate the efficiency of the proposed algorithm when compared with the state-of-the-art fusion methods.

References in corpus (2)

• Hyperspectral and Multispectral Image Fusion based on a Sparse Representation
• Bayesian Fusion of Multi-Band Images

Cited by in corpus (41)

• Hyperspectral and Multispectral Image Fusion based on a Sparse Representation
• Fast Fusion of Multi-Band Images Based on Solving a Sylvester Equation
• Hyperspectral Super-Resolution: A Coupled Tensor Factorization Approach
• Coupled Convolutional Neural Network with Adaptive Response Function Learning for Unsupervised Hyperspectral Super-Resolution
• Spectral Superresolution of Multispectral Imagery with Joint Sparse and Low-Rank Learning
• Multi-Band Image Fusion Based on Spectral Unmixing
• Model Inspired Autoencoder for Unsupervised Hyperspectral Image Super-Resolution
• R-FUSE: Robust Fast Fusion of Multi-Band Images Based on Solving a Sylvester Equation
• Hyperspectral Image Super-resolution via Deep Progressive Zero-centric Residual Learning
• Hyperspectral Super-Resolution with Coupled Tucker Approximation: Recoverability and SVD-based algorithms
• Hyperspectral Super-Resolution via Interpretable Block-Term Tensor Modeling
• Unsupervised and Unregistered Hyperspectral Image Super-Resolution with Mutual Dirichlet-Net
• Coupled Tensor Decomposition for Hyperspectral and Multispectral Image Fusion with Inter-Image Variability
• Hyperspectral Pansharpening: Critical Review, Tools and Future Perspectives
• On Plug-and-Play Regularization using Linear Denoisers
• Hyperspectral and multispectral image fusion under spectrally varying spatial blurs -- Application to high dimensional infrared astronomical imaging
• Multi-Resolution Beta-Divergence NMF for Blind Spectral Unmixing
• Hybrid Inexact BCD for Coupled Structured Matrix Factorization in Hyperspectral Super-Resolution
• Multisource and Multitemporal Data Fusion in Remote Sensing
• Deep Convolutional Neural Network for Multi-modal Image Restoration and Fusion
• Scene-Adapted Plug-and-Play Algorithm with Guaranteed Convergence: Applications to Data Fusion in Imaging
• Matrix cofactorization for joint spatial-spectral unmixing of hyperspectral images
• Deep Hyperspectral and Multispectral Image Fusion with Inter-image Variability
• Recent Advances and New Guidelines on Hyperspectral and Multispectral Image Fusion
• Hyperspectral Super-Resolution via Coupled Tensor Ring Factorization
• Zero-Shot Hyperspectral Pansharpening Using Hysteresis-Based Tuning for Spectral Quality Control
• Unsupervised Sparse Dirichlet-Net for Hyperspectral Image Super-Resolution
• Super-Resolution for Hyperspectral and Multispectral Image Fusion Accounting for Seasonal Spectral Variability
• Hyperspectral-Multispectral Image Fusion with Weighted LASSO
• Detecting Changes Between Optical Images of Different Spatial and Spectral Resolutions: a Fusion-Based Approach
• Multimodal Remote Sensing Benchmark Datasets for Land Cover Classification with A Shared and Specific Feature Learning Model
• Automated and Autonomous Experiment in Electron and Scanning Probe Microscopy
• Hyperspectral Image Super-Resolution via Deep Prior Regularization with Parameter Estimation
• Hyperspectral Super-resolution: A Coupled Nonnegative Block-term Tensor Decomposition Approach
• Gaussian process analysis of Electron Energy Loss Spectroscopy (EELS) data: parallel reconstruction and kernel control
• HYPERION: Hyperspectral Penetrating-type Ellipsoidal Reconstruction for Terahertz Blind Source Separation
• Learning A 3D-CNN and Transformer Prior for Hyperspectral Image Super-Resolution
• Robust Fusion of Multi-Band Images with Different Spatial and Spectral Resolutions for Change Detection
• Image Segmentation Using Subspace Representation and Sparse Decomposition
• Fusing Multiple Multiband Images
• Multispectral image fusion based on super pixel segmentation