Selective inference with a randomized response
arXiv:1507.06739
Abstract
Inspired by sample splitting and the reusable holdout introduced in the field of differential privacy, we consider selective inference with a randomized response. We discuss two major advantages of using a randomized response for model selection. First, the selectively valid tests are more powerful after randomized selection. Second, it allows consistent estimation and weak convergence of selective inference procedures. Under independent sampling, we prove a selective (or privatized) central limit theorem that transfers procedures valid under asymptotic normality without selection to their corresponding selective counterparts. This allows selective inference in nonparametric settings. Finally, we propose a framework of inference after combining multiple randomized selection procedures. We focus on the classical asymptotic setting, leaving the interesting high-dimensional asymptotic questions for future work.
References in corpus (11)
- Valid post-selection inference
- Square-Root Lasso: Pivotal Recovery of Sparse Signals via Conic Programming
- Exact and asymptotically robust permutation tests
- Optimal Inference After Model Selection
- Exact Post Model Selection Inference for Marginal Screening
- Exact Post-Selection Inference for Sequential Regression Procedures
- Selective inference with unknown variance via the square-root LASSO
- Preserving Statistical Validity in Adaptive Data Analysis
- MAGIC: a general, powerful and tractable method for selective inference
- Exact Hamiltonian Monte Carlo for Truncated Multivariate Gaussians
- Asymptotics of selective inference
Cited by in corpus (14)
- Optimal Inference After Model Selection
- Bootstrapping and Sample Splitting For High-Dimensional, Assumption-Free Inference
- MAGIC: a general, powerful and tractable method for selective inference
- Bootstrap inference after using multiple queries for model selection
- An MCMC-free approach to post-selective inference
- Approximate -penalized estimation of piecewise-constant signals on graphs
- Prediction error after model search
- Tractable Post-Selection Maximum Likelihood Inference for the Lasso
- Inference After Selecting Plausibly Valid Instruments with Application to Mendelian Randomization
- Test Error Estimation after Model Selection Using Validation Error
- Scalable methods for Bayesian selective inference
- Selection-adjusted inference: an application to confidence intervals for cis-eQTL effect sizes
- Analysis of error control in large scale two-stage multiple hypothesis testing
- A general framework for estimation and inference from clusters of features