A survey of sparse representation: algorithms and applications

Abstract

Sparse representation has attracted much attention from researchers in fields of signal processing, image processing, computer vision and pattern recognition. Sparse representation also has a good reputation in both theoretical research and practical applications. Many different algorithms have been proposed for sparse representation. The main purpose of this article is to provide a comprehensive study and an updated review on sparse representation and to supply a guidance for researchers. The taxonomy of sparse representation methods can be studied from various viewpoints. For example, in terms of different norm minimizations used in sparsity constraints, the methods can be roughly categorized into five groups: sparse representation with $l_0$-norm minimization, sparse representation with $l_p$-norm (0$<$p$<$1) minimization, sparse representation with $l_1$-norm minimization and sparse representation with $l_{2,1}$-norm minimization. In this paper, a comprehensive overview of sparse representation is provided. The available sparse representation algorithms can also be empirically categorized into four groups: greedy strategy approximation, constrained optimization, proximity algorithm-based optimization, and homotopy algorithm-based sparse representation. The rationales of different algorithms in each category are analyzed and a wide range of sparse representation applications are summarized, which could sufficiently reveal the potential nature of the sparse representation theory. Specifically, an experimentally comparative study of these sparse representation algorithms was presented. The Matlab code used in this paper can be available at: http://www.yongxu.org/lunwen.html.

Published on IEEE Access, Vol. 3, pp. 490-530, 2015

References in corpus (27)

• Rejoinder to "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Least Angle Regression
• Nearly unbiased variable selection under minimax concave penalty
• Message Passing Algorithms for Compressed Sensing
• Sparsity and Incoherence in Compressive Sampling
• Image Deblurring and Super-resolution by Adaptive Sparse Domain Selection and Adaptive Regularization
• NESTA: A Fast and Accurate First-order Method for Sparse Recovery
• Alternating Direction Algorithms for ${\ell }_1$-Problems in Compressive Sensing
• Supervised Dictionary Learning
• Templates for Convex Cone Problems with Applications to Sparse Signal Recovery
• Multi-Task Feature Learning Via Efficient l2,1-Norm Minimization
• $L_{1/2}$ Regularization: Convergence of Iterative Half Thresholding Algorithm
• Dynamic Updating for L1 Minimization
• Constructing a Non-Negative Low Rank and Sparse Graph with Data-Adaptive Features
• Fast L1-Minimization Algorithms For Robust Face Recognition
• Compressed Sensing Signal Recovery via Forward-Backward Pursuit
• Image Super-Resolution via Dual-Dictionary Learning And Sparse Representation
• An MDL framework for sparse coding and dictionary learning
• Sparse Recovery of Streaming Signals Using L1-Homotopy

Cited by in corpus (54)

• Sparse Polynomial Chaos Expansions: Literature Survey and Benchmark
• Trainable ISTA for Sparse Signal Recovery
• Tensor Methods in Computer Vision and Deep Learning
• Discriminative Block-Diagonal Representation Learning for Image Recognition
• A Survey on Deep Neural Network Compression: Challenges, Overview, and Solutions
• Towards Understanding Sparse Filtering: A Theoretical Perspective
• Quantitative phase and polarisation endoscopy applied to detection of early oesophageal tumourigenesis
• First and Second Order Methods for Online Convolutional Dictionary Learning
• ISTA-NAS: Efficient and Consistent Neural Architecture Search by Sparse Coding
• Robust Sonar ATR Through Bayesian Pose Corrected Sparse Classification
• CSC-Unet: A Novel Convolutional Sparse Coding Strategy Based Neural Network for Semantic Segmentation
• Inferring Sparsity: Compressed Sensing using Generalized Restricted Boltzmann Machines
• A Transfer Learning Framework for Anomaly Detection Using Model of Normality
• Application of Compressive Sensing Techniques in Distributed Sensor Networks: A Survey
• Sparse Stream Semantic Registers: A Lightweight ISA Extension Accelerating General Sparse Linear Algebra
• Cross-domain Joint Dictionary Learning for ECG Inference from PPG
• Playing Atari with Six Neurons
• Occamy: A 432-Core Dual-Chiplet Dual-HBM2E 768-DP-GFLOP/s RISC-V System for 8-to-64-bit Dense and Sparse Computing in 12nm FinFET
• Temporal Graph Signal Decomposition
• Compressed sensing reconstruction using Expectation Propagation
• Sparse Representation based Multi-sensor Image Fusion: A Review
• Kernel Recursive Least Squares Dictionary Learning Algorithm
• Natural Scene Character Recognition Using Robust PCA and Sparse Representation
• Compressive Spectrum Sensing for Cognitive Radio Networks
• Beyond Linear Subspace Clustering: A Comparative Study of Nonlinear Manifold Clustering Algorithms
• A tensor model for the calibration of air-coupled ultrasonic sensor arrays in 3D imaging
• Image Super-Resolution via RL-CSC: When Residual Learning Meets Convolutional Sparse Coding
• Learning sparse representations in reinforcement learning
• A Cosine Network for Image Super-Resolution
• Client-Specific Anomaly Detection for Face Presentation Attack Detection
• Superpixel based Class-Semantic Texton Occurrences for Natural Roadside Vegetation Segmentation
• Bi-level algorithm for optimizing hyperparameters in penalized nonnegative matrix factorization
• Improving Vehicle Re-Identification using CNN Latent Spaces: Metrics Comparison and Track-to-track Extension
• Discriminative Dictionary Learning based on Statistical Methods
• Fast and Robust High-Dimensional Sparse Representation Recovery Using Generalized SL0
• An adaptive shortest-solution guided decimation approach to sparse high-dimensional linear regression
• D-SELD: Dataset-Scalable Exemplar LCA-Decoder
• An Energy-efficient Wireless Neural Recording System with Compressed Sensing and Encryption
• WARP-LCA: Efficient Convolutional Sparse Coding with Locally Competitive Algorithm
• Group Sparse Precoding for Cloud-RAN with Multiple User Antennas
• CRNet: Image Super-Resolution Using A Convolutional Sparse Coding Inspired Network
• A comprehensive study of sparse representation techniques for offline signature verification
• Knowledge Distillation By Sparse Representation Matching
• Impulsive Noise Robust Sparse Recovery via Continuous Mixed Norm
• Hyperspectral Image Classification Based on Adaptive Sparse Deep Network
• Compressed Sensing with Probability-based Prior Information
• A sparsity augmented probabilistic collaborative representation based classification method
• Robust Classification with Sparse Representation Fusion on Diverse Data Subsets
• On reconstruction algorithms for signals sparse in Hermite and Fourier domains
• RSS-based Multiple Sources Localization with Unknown Log-normal Shadow Fading
• ComplexFace: a Multi-Representation Approach for Image Classification with Small Dataset
• Discriminative Localized Sparse Representations for Breast Cancer Screening
• Signal Processing Challenges and Examples for {\it in-situ} Transmission Electron Microscopy
• Sparse Representation of 3D Images for Piecewise Dimensionality Reduction with High Quality Reconstruction