Connections between Deep Equilibrium and Sparse Representation Models with Application to Hyperspectral Image Denoising

Abstract

In this study, the problem of computing a sparse representation of multi-dimensional visual data is considered. In general, such data e.g., hyperspectral images, color images or video data consists of signals that exhibit strong local dependencies. A new computationally efficient sparse coding optimization problem is derived by employing regularization terms that are adapted to the properties of the signals of interest. Exploiting the merits of the learnable regularization techniques, a neural network is employed to act as structure prior and reveal the underlying signal dependencies. To solve the optimization problem Deep unrolling and Deep equilibrium based algorithms are developed, forming highly interpretable and concise deep-learning-based architectures, that process the input dataset in a block-by-block fashion. Extensive simulation results, in the context of hyperspectral image denoising, are provided, which demonstrate that the proposed algorithms outperform significantly other sparse coding approaches and exhibit superior performance against recent state-of-the-art deep-learning-based denoising models. In a wider perspective, our work provides a unique bridge between a classic approach, that is the sparse representation theory, and modern representation tools that are based on deep learning modeling.

References in corpus (10)

• Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
• Spectral Normalization for Generative Adversarial Networks
• Deep Convolutional Neural Network for Inverse Problems in Imaging
• Hyperspectral Image Denoising Employing a Spatial-Spectral Deep Residual Convolutional Neural Network
• Efficient tensor completion for color image and video recovery: Low-rank tensor train
• Fast Hyperspectral Image Denoising and Inpainting Based on Low-Rank and Sparse Representations
• Results of the 2020 fastMRI Challenge for Machine Learning MR Image Reconstruction
• Image Restoration for Remote Sensing: Overview and Toolbox
• Computationally Efficient Deep Neural Network for Computed Tomography Image Reconstruction
• HyDe: The First Open-Source, Python-Based, GPU-Accelerated Hyperspectral Denoising Package

Cited by in corpus (2)

• LAMA-Net: A Convergent Network Architecture for Dual-Domain Reconstruction
• LAMA: Stable Dual-Domain Deep Reconstruction For Sparse-View CT