Reconstruction of Signals Drawn from a Gaussian Mixture from Noisy Compressive Measurements
arXiv:1307.0861 · doi:10.1109/TSP.2014.2309560
Abstract
This paper determines to within a single measurement the minimum number of measurements required to successfully reconstruct a signal drawn from a Gaussian mixture model in the low-noise regime. The method is to develop upper and lower bounds that are a function of the maximum dimension of the linear subspaces spanned by the Gaussian mixture components. The method not only reveals the existence or absence of a minimum mean-squared error (MMSE) error floor (phase transition) but also provides insight into the MMSE decay via multivariate generalizations of the MMSE dimension and the MMSE power offset, which are a function of the interaction between the geometrical properties of the kernel and the Gaussian mixture. These results apply not only to standard linear random Gaussian measurements but also to linear kernels that minimize the MMSE. It is shown that optimal kernels do not change the number of measurements associated with the MMSE phase transition, rather they affect the sensed power required to achieve a target MMSE in the low-noise regime. Overall, our bounds are tighter and sharper than standard bounds on the minimum number of measurements needed to recover sparse signals associated with a union of subspaces model, as they are not asymptotic in the signal dimension or signal sparsity.
arXiv commentAccepted for publication in the IEEE Transactions on Signal Processing
References in corpus (11)
- Message Passing Algorithms for Compressed Sensing
- Compressed Sensing of Block-Sparse Signals: Uncertainty Relations and Efficient Recovery
- Model-Based Compressive Sensing
- The dynamics of message passing on dense graphs, with applications to compressed sensing
- Observed Universality of Phase Transitions in High-Dimensional Geometry, with Implications for Modern Data Analysis and Signal Processing
- Asymptotic Analysis of MAP Estimation via the Replica Method and Applications to Compressed Sensing
- Statistical Compressed Sensing of Gaussian Mixture Models
- Communications-Inspired Projection Design with Application to Compressive Sensing
- Task-Driven Adaptive Statistical Compressive Sensing of Gaussian Mixture Models
- Online Adaptive Statistical Compressed Sensing of Gaussian Mixture Models
- Minimum Mean Square Error Estimation Under Gaussian Mixture Statistics
Cited by in corpus (7)
- Classification and Reconstruction of High-Dimensional Signals from Low-Dimensional Features in the Presence of Side Information
- Compressed Sensing with Prior Information: Optimal Strategies, Geometry, and Bounds
- Bounds on the Number of Measurements for Reliable Compressive Classification
- Neumann Networks for Inverse Problems in Imaging
- The Role of Principal Angles in Subspace Classification
- Compressive Classification of a Mixture of Gaussians: Analysis, Designs and Geometrical Interpretation
- Multilinear Compressive Learning with Prior Knowledge