An Augmented Linear Mixing Model to Address Spectral Variability for Hyperspectral Unmixing

Abstract

Hyperspectral imagery collected from airborne or satellite sources inevitably suffers from spectral variability, making it difficult for spectral unmixing to accurately estimate abundance maps. The classical unmixing model, the linear mixing model (LMM), generally fails to handle this sticky issue effectively. To this end, we propose a novel spectral mixture model, called the augmented linear mixing model (ALMM), to address spectral variability by applying a data-driven learning strategy in inverse problems of hyperspectral unmixing. The proposed approach models the main spectral variability (i.e., scaling factors) generated by variations in illumination or typography separately by means of the endmember dictionary. It then models other spectral variabilities caused by environmental conditions (e.g., local temperature and humidity, atmospheric effects) and instrumental configurations (e.g., sensor noise), as well as material nonlinear mixing effects, by introducing a spectral variability dictionary. To effectively run the data-driven learning strategy, we also propose a reasonable prior knowledge for the spectral variability dictionary, whose atoms are assumed to be low-coherent with spectral signatures of endmembers, which leads to a well-known low coherence dictionary learning problem. Thus, a dictionary learning technique is embedded in the framework of spectral unmixing so that the algorithm can learn the spectral variability dictionary and estimate the abundance maps simultaneously. Extensive experiments on synthetic and real datasets are performed to demonstrate the superiority and effectiveness of the proposed method in comparison with previous state-of-the-art methods.

Cited by in corpus (52)

• Graph Convolutional Networks for Hyperspectral Image Classification
• More Diverse Means Better: Multimodal Deep Learning Meets Remote Sensing Imagery Classification
• Feature Extraction for Hyperspectral Imagery: The Evolution from Shallow to Deep (Overview and Toolbox)
• Multimodal Fusion Transformer for Remote Sensing Image Classification
• Classification of Hyperspectral and LiDAR Data Using Coupled CNNs
• Hyperspectral Image Classification-Traditional to Deep Models: A Survey for Future Prospects
• Deep Learning for UAV-based Object Detection and Tracking: A Survey
• Invariant Attribute Profiles: A Spatial-Frequency Joint Feature Extractor for Hyperspectral Image Classification
• Spectral Variability in Hyperspectral Data Unmixing: A Comprehensive Review
• X-ModalNet: A Semi-Supervised Deep Cross-Modal Network for Classification of Remote Sensing Data
• ORSIm Detector: A Novel Object Detection Framework in Optical Remote Sensing Imagery Using Spatial-Frequency Channel Features
• Coupled Convolutional Neural Network with Adaptive Response Function Learning for Unsupervised Hyperspectral Super-Resolution
• Spectral Superresolution of Multispectral Imagery with Joint Sparse and Low-Rank Learning
• Fourier-based Rotation-invariant Feature Boosting: An Efficient Framework for Geospatial Object Detection
• Polarimetric SAR Image Semantic Segmentation with 3D Discrete Wavelet Transform and Markov Random Field
• Multi-Content Complementation Network for Salient Object Detection in Optical Remote Sensing Images
• Pansharpening by convolutional neural networks in the full resolution framework
• Hyperspectral Image Super-resolution via Deep Progressive Zero-centric Residual Learning
• A Comprehensive Survey for Hyperspectral Image Classification: The Evolution from Conventional to Transformers and Mamba Models
• Using Low-rank Representation of Abundance Maps and Nonnegative Tensor Factorization for Hyperspectral Nonlinear Unmixing
• A framework for large-scale mapping of human settlement extent from Sentinel-2 images via fully convolutional neural networks
• MIMA: MAPPER-Induced Manifold Alignment for Semi-Supervised Fusion of Optical Image and Polarimetric SAR Data
• Hyperspectral Unmixing via Deep Autoencoder Networks for a Generalized Linear-Mixture/Nonlinear-Fluctuation Model
• Learning Convolutional Sparse Coding on Complex Domain for Interferometric Phase Restoration
• Learning Shared Cross-modality Representation Using Multispectral-LiDAR and Hyperspectral Data
• Convolutional Neural Network Ensemble Learning for Hyperspectral Imaging-based Blackberry Fruit Ripeness Detection in Uncontrolled Farm Environment
• Vehicle Detection of Multi-source Remote Sensing Data Using Active Fine-tuning Network
• Asymmetric Hash Code Learning for Remote Sensing Image Retrieval
• Semantic-aware Dense Representation Learning for Remote Sensing Image Change Detection
• Full-resolution quality assessment for pansharpening
• Image Processing and Machine Learning for Hyperspectral Unmixing: An Overview and the HySUPP Python Package
• Spectral Variability Aware Blind Hyperspectral Image Unmixing Based on Convex Geometry
• Multitask Deep Learning with Spectral Knowledge for Hyperspectral Image Classification
• A Data Dependent Multiscale Model for Hyperspectral Unmixing With Spectral Variability
• Spectral Variability Augmented Sparse Unmixing of Hyperspectral Images
• SpectralFormer: Rethinking Hyperspectral Image Classification with Transformers
• Illumination invariant hyperspectral image unmixing based on a digital surface model
• Dynamical Hyperspectral Unmixing with Variational Recurrent Neural Networks
• 3D Instance Segmentation of MVS Buildings
• Style Alignment based Dynamic Observation Method for UAV-View Geo-localization
• Convolutional Neural Networks Rarely Learn Shape for Semantic Segmentation
• Fast Unmixing and Change Detection in Multitemporal Hyperspectral Data
• DDF: A Novel Dual-Domain Image Fusion Strategy for Remote Sensing Image Semantic Segmentation with Unsupervised Domain Adaptation
• Learning Interpretable Deep Disentangled Neural Networks for Hyperspectral Unmixing
• Content-driven Magnitude-Derivative Spectrum Complementary Learning for Hyperspectral Image Classification
• Rotation Equivariant Feature Image Pyramid Network for Object Detection in Optical Remote Sensing Imagery
• Distributed Learning over Networks with Graph-Attention-Based Personalization
• Incomplete Multimodal Industrial Anomaly Detection via Cross-Modal Distillation
• Representation Learning via Cauchy Convolutional Sparse Coding
• MultiHU-TD: Multifeature Hyperspectral Unmixing Based on Tensor Decomposition
• Bidirectional recurrent imputation and abundance estimation of LULC classes with MODIS multispectral time series and geo-topographic and climatic data
• Multi-patch Feature Pyramid Network for Weakly Supervised Object Detection in Optical Remote Sensing Images