Task-Driven Adaptive Statistical Compressive Sensing of Gaussian Mixture Models

Abstract

A framework for adaptive and non-adaptive statistical compressive sensing is developed, where a statistical model replaces the standard sparsity model of classical compressive sensing. We propose within this framework optimal task-specific sensing protocols specifically and jointly designed for classification and reconstruction. A two-step adaptive sensing paradigm is developed, where online sensing is applied to detect the signal class in the first step, followed by a reconstruction step adapted to the detected class and the observed samples. The approach is based on information theory, here tailored for Gaussian mixture models (GMMs), where an information-theoretic objective relationship between the sensed signals and a representation of the specific task of interest is maximized. Experimental results using synthetic signals, Landsat satellite attributes, and natural images of different sizes and with different noise levels show the improvements achieved using the proposed framework when compared to more standard sensing protocols. The underlying formulation can be applied beyond GMMs, at the price of higher mathematical and computational complexity.

References in corpus (5)

• Structured Compressed Sensing: From Theory to Applications
• Statistical Compressed Sensing of Gaussian Mixture Models
• Certain Relations between Mutual Information and Fidelity of Statistical Estimation
• Sequential adaptive compressed sampling via Huffman codes
• Online Adaptive Statistical Compressed Sensing of Gaussian Mixture Models

Cited by in corpus (11)

• Compressive Hyperspectral Imaging with Side Information
• Adaptive Temporal Compressive Sensing for Video
• Reconstruction of Signals Drawn from a Gaussian Mixture from Noisy Compressive Measurements
• Classification and Reconstruction of High-Dimensional Signals from Low-Dimensional Features in the Presence of Side Information
• Adaptive-Rate Compressive Sensing Using Side Information
• Bounds on the Number of Measurements for Reliable Compressive Classification
• Bounds on mutual information of mixture data for classification tasks
• On Convolutional Approximations to Linear Dimensionality Reduction Operators for Large Scale Data Processing
• Compressive Measurement Designs for Estimating Structured Signals in Structured Clutter: A Bayesian Experimental Design Approach
• Domain-invariant Face Recognition using Learned Low-rank Transformation
• Sequential Sensing with Model Mismatch