Goodness of fit tests for high-dimensional linear models
arXiv:1511.03334 · doi:10.1111/rssb.12234
Abstract
In this work we propose a framework for constructing goodness of fit tests in both low and high-dimensional linear models. We advocate applying regression methods to the scaled residuals following either an ordinary least squares or Lasso fit to the data, and using some proxy for prediction error as the final test statistic. We call this family Residual Prediction (RP) tests. We show that simulation can be used to obtain the critical values for such tests in the low-dimensional setting, and demonstrate using both theoretical results and extensive numerical studies that some form of the parametric bootstrap can do the same when the high-dimensional linear model is under consideration. We show that RP tests can be used to test for significance of groups or individual variables as special cases, and here they compare favourably with state of the art methods, but we also argue that they can be designed to test for as diverse model misspecifications as heteroscedasticity and nonlinearity.
arXiv comment42 pages, 12 figures
References in corpus (31)
- Discussion of "Least angle regression" by Efron et al
- Least Angle Regression
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Rejoinder to "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Nearly unbiased variable selection under minimax concave penalty
- High-dimensional graphs and variable selection with the Lasso
- Simultaneous analysis of Lasso and Dantzig selector
- On asymptotically optimal confidence regions and tests for high-dimensional models
- On the conditions used to prove oracle results for the Lasso
- Confidence Intervals and Hypothesis Testing for High-Dimensional Regression
- Square-Root Lasso: Pivotal Recovery of Sparse Signals via Conic Programming
- A significance test for the lasso
- High-dimensional variable selection
- Variable selection with error control: Another look at Stability Selection
- Asymptotic normality and optimalities in estimation of large Gaussian graphical models
- Statistical significance in high-dimensional linear models
- High-Dimensional Inference: Confidence Intervals, -Values and R-Software hdi
- The Dantzig selector and sparsity oracle inequalities
- Sparse Matrix Inversion with Scaled Lasso
- High-dimensional inference in misspecified linear models
- P-values for high-dimensional regression
- A General Theory of Hypothesis Tests and Confidence Regions for Sparse High Dimensional Models
- Inference in High Dimensions with the Penalized Score Test
- Monte Carlo Simulation for Lasso-Type Problems by Estimator Augmentation
- Uncertainty Quantification Under Group Sparsity
Cited by in corpus (7)
- The Hardness of Conditional Independence Testing and the Generalised Covariance Measure
- Testability of high-dimensional linear models with non-sparse structures
- Hierarchical inference for genome-wide association studies: a view on methodology with software
- Rank-transformed subsampling: inference for multiple data splitting and exchangeable p-values
- Robust Estimation of Heterogeneous Treatment Effects using Electronic Health Record Data
- Higher-order least squares: assessing partial goodness of fit of linear causal models
- Berry-Esseen Bounds for Projection Parameters and Partial Correlations with Increasing Dimension