Type I and Type II Bayesian Methods for Sparse Signal Recovery using Scale Mixtures

Abstract

In this paper, we propose a generalized scale mixture family of distributions, namely the Power Exponential Scale Mixture (PESM) family, to model the sparsity inducing priors currently in use for sparse signal recovery (SSR). We show that the successful and popular methods such as LASSO, Reweighted ${\ell }_1$ and Reweighted ${\ell }_2$ methods can be formulated in an unified manner in a maximum a posteriori (MAP) or Type I Bayesian framework using an appropriate member of the PESM family as the sparsity inducing prior. In addition, exploiting the natural hierarchical framework induced by the PESM family, we utilize these priors in a Type II framework and develop the corresponding EM based estimation algorithms. Some insight into the differences between Type I and Type II methods is provided and of particular interest in the algorithmic development is the Type II variant of the popular and successful reweighted ${\ell }_1$ method. Extensive empirical results are provided and they show that the Type II methods exhibit better support recovery than the corresponding Type I methods.

Under Review

Cited by in corpus (12)

• Multi Snapshot Sparse Bayesian Learning for DOA Estimation
• A GAMP Based Low Complexity Sparse Bayesian Learning Algorithm
• Sparse Bayesian learning with uncertainty models and multiple dictionaries
• Graph-based sequential beamforming
• Multimodal Sparse Bayesian Dictionary Learning
• Sparse Bayesian Learning for DOA Estimation in Heteroscedastic Noise
• Relevance Subject Machine: A Novel Person Re-identification Framework
• A Binarizing NUV Prior and its Use for M-Level Control and Digital-to-Analog Conversion
• Total Variation Bayesian Learning via Synthesis
• On Identification of Sparse Multivariable ARX Model: A Sparse Bayesian Learning Approach
• Sparse Bayesian Inference of Multivariable ARX Networks
• Adaptive support driven Bayesian reweighted algorithm for sparse signal recovery