Confidence sets in sparse regression

Abstract

The problem of constructing confidence sets in the high-dimensional linear model with $n$ response variables and $p$ parameters, possibly $p\ge n$, is considered. Full honest adaptive inference is possible if the rate of sparse estimation does not exceed $n^{-1/4}$, otherwise sparse adaptive confidence sets exist only over strict subsets of the parameter spaces for which sparse estimators exist. Necessary and sufficient conditions for the existence of confidence sets that adapt to a fixed sparsity level of the parameter vector are given in terms of minimal ${\ell }^2$-separation conditions on the parameter space. The design conditions cover common coherence assumptions used in models for sparsity, including (possibly correlated) sub-Gaussian designs.

Published in at http://dx.doi.org/10.1214/13-AOS1170 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (6)

• Confidence Intervals and Hypothesis Testing for High-Dimensional Regression
• Confidence bands in density estimation
• ${\ell }_0$-penalized maximum likelihood for sparse directed acyclic graphs
• On adaptive inference and confidence bands
• Adaptive nonparametric confidence sets
• Adaptive confidence balls

Cited by in corpus (20)

• On asymptotically optimal confidence regions and tests for high-dimensional models
• Confidence intervals for high-dimensional inverse covariance estimation
• Linear Hypothesis Testing in Dense High-Dimensional Linear Models
• Testability of high-dimensional linear models with non-sparse structures
• Uncertainty Quantification for Matrix Compressed Sensing and Quantum Tomography Problems
• Error regions in quantum state tomography: computational complexity caused by geometry of quantum states
• Floodgate: inference for model-free variable importance
• Greedy algorithms for prediction
• Sparse High-Dimensional Linear Regression. Algorithmic Barriers and a Local Search Algorithm
• Second order Stein: SURE for SURE and other applications in high-dimensional inference
• Testing the regularity of a smooth signal
• Accuracy Assessment for High-dimensional Linear Regression
• High-Dimensional Regression with Binary Coefficients. Estimating Squared Error and a Phase Transition
• Estimating the Lasso's Effective Noise
• Optimal Statistical Inference for Individualized Treatment Effects in High-dimensional Models
• Sharp multiple testing boundary for sparse sequences
• Discussion of "Frequentist coverage of adaptive nonparametric Bayesian credible sets"
• Moderate-Dimensional Inferences on Quadratic Functionals in Ordinary Least Squares
• Honest confidence sets for high-dimensional regression by projection and shrinkage
• On the uniform convergence of empirical norms and inner products, with application to causal inference