Exact Post Model Selection Inference for Marginal Screening
arXiv:1402.5596
Abstract
We develop a framework for post model selection inference, via marginal screening, in linear regression. At the core of this framework is a result that characterizes the exact distribution of linear functions of the response , conditional on the model being selected (``condition on selection" framework). This allows us to construct valid confidence intervals and hypothesis tests for regression coefficients that account for the selection procedure. In contrast to recent work in high-dimensional statistics, our results are exact (non-asymptotic) and require no eigenvalue-like assumptions on the design matrix . Furthermore, the computational cost of marginal regression, constructing confidence intervals and hypothesis testing is negligible compared to the cost of linear regression, thus making our methods particularly suitable for extremely large datasets. Although we focus on marginal screening to illustrate the applicability of the condition on selection framework, this framework is much more broadly applicable. We show how to apply the proposed framework to several other selection procedures including orthogonal matching pursuit, non-negative least squares, and marginal screening+Lasso.
References in corpus (14)
- Discussion of "Least angle regression" by Efron et al
- Rejoinder to "Least angle regression" by Efron et al
- Least Angle Regression
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Confidence Intervals and Hypothesis Testing for High-Dimensional Regression
- Sure independence screening in generalized linear models with NP-dimensionality
- Valid post-selection inference
- High-dimensional additive modeling
Cited by in corpus (25)
- Optimal Inference After Model Selection
- Valid Post-Selection and Post-Regularization Inference: An Elementary, General Approach
- Exact Post-Selection Inference for Sequential Regression Procedures
- Estimation after Parameter Selection: Performance Analysis and Estimation Methods
- Selective inference with a randomized response
- Selective inference with unknown variance via the square-root LASSO
- On the Post Selection Inference constant under Restricted Isometry Properties
- Sequential Selection Procedures and False Discovery Rate Control
- Bootstrap inference after using multiple queries for model selection
- Exact Post-Selection Inference for Changepoint Detection and Other Generalized Lasso Problems
- An MCMC-free approach to post-selective inference
- Tractable Post-Selection Maximum Likelihood Inference for the Lasso
- Inferring Treatment Effects After Testing Instrument Strength in Linear Models
- Inference After Selecting Plausibly Valid Instruments with Application to Mendelian Randomization
- A Selective Approach to Internal Inference
- Selective Inference for Change Point Detection in Multi-dimensional Sequences
- Non-reversible, tuning- and rejection-free Markov chain Monte Carlo via iterated random functions
- Post model-fitting exploration via a "Next-Door" analysis
- Selection-adjusted inference: an application to confidence intervals for cis-eQTL effect sizes
- Selective Inference in Propensity Score Analysis
- Pessimistic Model Selection for Offline Deep Reinforcement Learning
- Selective Confidence Intervals for Martingale Regression Model
- Selective Inference Approach for Statistically Sound Predictive Pattern Mining
- Selective Inference via Marginal Screening for High Dimensional Classification
- Selective Inference for Latent Block Models