Statistical significance in high-dimensional linear models

Abstract

We propose a method for constructing p-values for general hypotheses in a high-dimensional linear model. The hypotheses can be local for testing a single regression parameter or they may be more global involving several up to all parameters. Furthermore, when considering many hypotheses, we show how to adjust for multiple testing taking dependence among the p-values into account. Our technique is based on Ridge estimation with an additional correction term due to a substantial projection bias in high dimensions. We prove strong error control for our p-values and provide sufficient conditions for detection: for the former, we do not make any assumption on the size of the true underlying regression coefficients while regarding the latter, our procedure might not be optimal in terms of power. We demonstrate the method in simulated examples and a real data application.

Published in at http://dx.doi.org/10.3150/12-BEJSP11 the Bernoulli (http://isi.cbs.nl/bernoulli/) by the International Statistical Institute/Bernoulli Society (http://isi.cbs.nl/BS/bshome.htm)

References in corpus (11)

• Nearly unbiased variable selection under minimax concave penalty
• Asymptotic properties of bridge estimators in sparse high-dimensional regression models
• The sparsity and bias of the Lasso selection in high-dimensional linear regression
• Lasso-type recovery of sparse representations for high-dimensional data
• High-dimensional generalized linear models and the lasso
• High-dimensional variable selection
• Sparsity oracle inequalities for the Lasso
• The Dantzig selector and sparsity oracle inequalities
• Estimation in high-dimensional linear models with deterministic design matrices
• P-values for high-dimensional regression
• Confidence Intervals for Low-Dimensional Parameters in High-Dimensional Linear Models

Cited by in corpus (43)

• On asymptotically optimal confidence regions and tests for high-dimensional models
• Confidence Intervals and Hypothesis Testing for High-Dimensional Regression
• A significance test for the lasso
• SLOPE - Adaptive variable selection via convex optimization
• Asymptotic normality and optimalities in estimation of large Gaussian graphical models
• High-Dimensional Inference: Confidence Intervals, $p$-Values and R-Software hdi
• High-dimensional inference in misspecified linear models
• Linear Hypothesis Testing in Dense High-Dimensional Linear Models
• Goodness of fit tests for high-dimensional linear models
• Geometric Inference for General High-Dimensional Linear Inverse Problems
• Estimating the error variance in a high-dimensional linear model
• Testability of high-dimensional linear models with non-sparse structures
• Hierarchical inference for genome-wide association studies: a view on methodology with software
• On the dimension effect of regularized linear discriminant analysis
• A Bootstrap Lasso + Partial Ridge Method to Construct Confidence Intervals for Parameters in High-dimensional Sparse Linear Models
• Model Selection for High-Dimensional Regression under the Generalized Irrepresentability Condition
• Floodgate: inference for model-free variable importance
• A projection pursuit framework for testing general high-dimensional hypothesis
• On the Sensitivity of the Lasso to the Number of Predictor Variables
• Greedy algorithms for prediction
• Discussion of Big Bayes Stories and BayesBag
• Method of Contraction-Expansion (MOCE) for Simultaneous Inference in Linear Models
• Discussion: "A significance test for the lasso"
• The geometry of least squares in the 21st century
• Group-bound: confidence intervals for groups of variables in sparse high-dimensional regression without assumptions on the design
• Gaussian Graphical Model Estimation with False Discovery Rate Control
• Higher-order least squares: assessing partial goodness of fit of linear causal models
• Statistical control for spatio-temporal MEG/EEG source imaging with desparsified multi-task Lasso
• High-dimensional structure learning of sparse vector autoregressive models using fractional marginal pseudo-likelihood
• Two-Stage Robust and Sparse Distributed Statistical Inference for Large-Scale Data
• Culling the herd of moments with penalized empirical likelihood
• The Benefit of Group Sparsity in Group Inference with De-biased Scaled Group Lasso
• Uncertainty Quantification for High Dimensional Sparse Nonparametric Additive Models
• Analysis of Networks via the Sparse $\beta$-Model
• Markov Neighborhood Regression for High-Dimensional Inference
• Causal aggregation: estimation and inference of causal effects by constraint-based data fusion
• Non-asymptotic error controlled sparse high dimensional precision matrix estimation
• Statistical significance in high-dimensional linear mixed models
• Tuning-free ridge estimators for high-dimensional generalized linear models
• Asymptotic normality of robust $M$-estimators with convex penalty
• Causal Discovery in High-Dimensional Point Process Networks with Hidden Nodes
• Two-directional simultaneous inference for high-dimensional models
• Scalable simultaneous inference in high-dimensional linear regression models