Constrained adaptive sensing

Abstract

Suppose that we wish to estimate a vector $\mathbf{x}\in {\mathbb{C}}^n$ from a small number of noisy linear measurements of the form $\mathbf{y}=\mathbf{Ax}+\mathbf{z}$, where $\mathbf{z}$ represents measurement noise. When the vector $\mathbf{x}$ is sparse, meaning that it has only $s$ nonzeros with $s\ll n$, one can obtain a significantly more accurate estimate of $\mathbf{x}$ by adaptively selecting the rows of $\mathbf{A}$ based on the previous measurements provided that the signal-to-noise ratio (SNR) is sufficiently large. In this paper we consider the case where we wish to realize the potential of adaptivity but where the rows of $\mathbf{A}$ are subject to physical constraints. In particular, we examine the case where the rows of $\mathbf{A}$ are constrained to belong to a finite set of allowable measurement vectors. We demonstrate both the limitations and advantages of adaptive sensing in this constrained setting. We prove that for certain measurement ensembles, the benefits offered by adaptive designs fall far short of the improvements that are possible in the unconstrained adaptive setting. On the other hand, we also provide both theoretical and empirical evidence that in some scenarios adaptivity does still result in substantial improvements even in the constrained setting. To illustrate these potential gains, we propose practical algorithms for constrained adaptive sensing by exploiting connections to the theory of optimal experimental design and show that these algorithms exhibit promising performance in some representative applications.

23 pages, 7 figures

Cited by in corpus (6)

• Sparse Polynomial Chaos Expansions via Compressed Sensing and D-optimal Design
• Signal Representations on Graphs: Tools and Applications
• Efficient active learning of sparse halfspaces with arbitrary bounded noise
• Elementary Symmetric Polynomials for Optimal Experimental Design
• A Practical Study of Longitudinal Reference Based Compressed Sensing for MRI
• A statistical perspective of sampling scores for linear regression