Spectral Variability in Hyperspectral Data Unmixing: A Comprehensive Review

Abstract

The spectral signatures of the materials contained in hyperspectral images, also called endmembers (EM), can be significantly affected by variations in atmospheric, illumination or environmental conditions typically occurring within an image. Traditional spectral unmixing (SU) algorithms neglect the spectral variability of the endmembers, what propagates significant mismodeling errors throughout the whole unmixing process and compromises the quality of its results. Therefore, large efforts have been recently dedicated to mitigate the effects of spectral variability in SU. This resulted in the development of algorithms that incorporate different strategies to allow the EMs to vary within a hyperspectral image, using, for instance, sets of spectral signatures known a priori, Bayesian, parametric, or local EM models. Each of these approaches has different characteristics and underlying motivations. This paper presents a comprehensive literature review contextualizing both classic and recent approaches to solve this problem. We give a detailed evaluation of the sources of spectral variability and their effect in image spectra. Furthermore, we propose a new taxonomy that organizes existing works according to a practitioner's point of view, based on the necessary amount of supervision and on the computational cost they require. We also review methods used to construct spectral libraries (which are required by many SU techniques) based on the observed hyperspectral image, as well as algorithms for library augmentation and reduction. Finally, we conclude the paper with some discussions and an outline of possible future directions for the field.

Published at the IEEE Geoscience and Remote Sensing Magazine

References in corpus (23)

• Deep learning in remote sensing: a review
• An Augmented Linear Mixing Model to Address Spectral Variability for Hyperspectral Unmixing
• Nonlinear unmixing of hyperspectral images: models and algorithms
• Joint Bayesian endmember extraction and linear unmixing for hyperspectral imagery
• Hyperspectral unmixing with spectral variability using a perturbed linear mixing model
• Deep Generative Endmember Modeling: An Application to Unsupervised Spectral Unmixing
• Tech Report: A Fast Multiscale Spatial Regularization for Sparse Hyperspectral Unmixing
• A Blind Multiscale Spatial Regularization Framework for Kernel-based Spectral Unmixing
• Hyperspectral Image Unmixing with Endmember Bundles and Group Sparsity Inducing Mixed Norms
• A Gaussian mixture model representation of endmember variability in hyperspectral unmixing
• Semiblind Hyperspectral Unmixing in the Presence of Spectral Library Mismatches
• Unsupervised Unmixing of Hyperspectral Images Accounting for Endmember Variability
• Hyperspectral Unmixing in Presence of Endmember Variability, Nonlinearity or Mismodelling Effects
• Dynamical spectral unmixing of multitemporal hyperspectral images
• Hyperspectral unmixing with spectral variability using adaptive bundles and double sparsity
• Spectral Variability Aware Blind Hyperspectral Image Unmixing Based on Convex Geometry
• Online Unmixing of Multitemporal Hyperspectral Images accounting for Spectral Variability
• A spatial compositional model (SCM) for linear unmixing and endmember uncertainty estimation
• A Data Dependent Multiscale Model for Hyperspectral Unmixing With Spectral Variability
• Spectral Unmixing: A Derivation of the Extended Linear Mixing Model from the Hapke Model
• Deep Generative Models for Library Augmentation in Multiple Endmember Spectral Mixture Analysis
• Kalman Filtering and Expectation Maximization for Multitemporal Spectral Unmixing
• Improved Hyperspectral Unmixing With Endmember Variability Parametrized Using an Interpolated Scaling Tensor

Cited by in corpus (18)

• DCN-T: Dual Context Network with Transformer for Hyperspectral Image Classification
• Integration of Physics-Based and Data-Driven Models for Hyperspectral Image Unmixing
• Computational Spectral Imaging: A Contemporary Overview
• Image Processing and Machine Learning for Hyperspectral Unmixing: An Overview and the HySUPP Python Package
• Spectral Variability Augmented Sparse Unmixing of Hyperspectral Images
• Dynamical Hyperspectral Unmixing with Variational Recurrent Neural Networks
• Fast Unmixing and Change Detection in Multitemporal Hyperspectral Data
• Unsupervised Diffusion and Volume Maximization-Based Clustering of Hyperspectral Images
• Learning Interpretable Deep Disentangled Neural Networks for Hyperspectral Unmixing
• Classification of grapevine varieties using UAV hyperspectral imaging
• SUnAA: Sparse Unmixing using Archetypal Analysis
• Deep Hyperspectral and Multispectral Image Fusion with Inter-image Variability
• Personalized Coupled Tensor Decomposition for Multimodal Data Fusion: Uniqueness and Algorithms
• Interferometer response characterization algorithm for multi-aperture Fabry-Perot imaging spectrometers
• A Generalized Multiscale Bundle-Based Hyperspectral Sparse Unmixing Algorithm
• MultiHU-TD: Multifeature Hyperspectral Unmixing Based on Tensor Decomposition
• Hierarchical Homogeneity-Based Superpixel Segmentation: Application to Hyperspectral Image Analysis
• Hyperspectral data augmentation with transformer-based diffusion models