An Empirical-Bayes Approach to Recovering Linearly Constrained Non-Negative Sparse Signals
arXiv:1310.2806 · doi:10.1109/TSP.2014.2337841
Abstract
We propose two novel approaches to the recovery of an (approximately) sparse signal from noisy linear measurements in the case that the signal is a priori known to be non-negative and obey given linear equality constraints, such as simplex signals. This problem arises in, e.g., hyperspectral imaging, portfolio optimization, density estimation, and certain cases of compressive imaging. Our first approach solves a linearly constrained non-negative version of LASSO using the max-sum version of the generalized approximate message passing (GAMP) algorithm, where we consider both quadratic and absolute loss, and where we propose a novel approach to tuning the LASSO regularization parameter via the expectation maximization (EM) algorithm. Our second approach is based on the sum-product version of the GAMP algorithm, where we propose the use of a Bernoulli non-negative Gaussian-mixture signal prior and a Laplacian likelihood, and propose an EM-based approach to learning the underlying statistical parameters. In both approaches, the linear equality constraints are enforced by augmenting GAMP's generalized-linear observation model with noiseless pseudo-measurements. Extensive numerical experiments demonstrate the state-of-the-art performance of our proposed approaches.
References in corpus (9)
- Message Passing Algorithms for Compressed Sensing
- Templates for Convex Cone Problems with Applications to Sparse Signal Recovery
- Expectation-Maximization Gaussian-Mixture Approximate Message Passing
- Sparse and stable Markowitz portfolios
- Optimally Tuned Iterative Reconstruction Algorithms for Compressed Sensing
- Bilinear Generalized Approximate Message Passing
- Fast and Robust Recursive Algorithms for Separable Nonnegative Matrix Factorization
- Sparse projections onto the simplex
- Approximate Message Passing with Consistent Parameter Estimation and Applications to Sparse Learning
Cited by in corpus (9)
- Compressive Phase Retrieval via Generalized Approximate Message Passing
- A Survey of Stochastic Simulation and Optimization Methods in Signal Processing
- Type I and Type II Bayesian Methods for Sparse Signal Recovery using Scale Mixtures
- Two-Dimensional Pattern-Coupled Sparse Bayesian Learning via Generalized Approximate Message Passing
- Binary Linear Classification and Feature Selection via Generalized Approximate Message Passing
- Fixed Points of Generalized Approximate Message Passing with Arbitrary Matrices
- Inference for Generalized Linear Models via Alternating Directions and Bethe Free Energy Minimization
- Generalized Approximate Message Passing for Cosparse Analysis Compressive Sensing
- Compressive Computed Tomography Reconstruction through Denoising Approximate Message Passing