Uniform Post Selection Inference for LAD Regression and Other Z-estimation problems

Abstract

We develop uniformly valid confidence regions for regression coefficients in a high-dimensional sparse median regression model with homoscedastic errors. Our methods are based on a moment equation that is immunized against non-regular estimation of the nuisance part of the median regression function by using Neyman's orthogonalization. We establish that the resulting instrumental median regression estimator of a target regression coefficient is asymptotically normally distributed uniformly with respect to the underlying sparse model and is semi-parametrically efficient. We also generalize our method to a general non-smooth Z-estimation framework with the number of target parameters $p_1$ being possibly much larger than the sample size $n$. We extend Huber's results on asymptotic normality to this setting, demonstrating uniform asymptotic normality of the proposed estimators over $p_1$-dimensional rectangles, constructing simultaneous confidence bands on all of the $p_1$ target parameters, and establishing asymptotic validity of the bands uniformly over underlying approximately sparse models. Keywords: Instrument; Post-selection inference; Sparsity; Neyman's Orthogonal Score test; Uniformly valid inference; Z-estimation.

includes supplementary material; 2 figures

References in corpus (4)

• Sparse Estimators and the Oracle Property, or the Return of Hodges' Estimator
• Gaussian approximation of suprema of empirical processes
• A simple invariance theorem
• Group Lasso for high dimensional sparse quantile regression models

Cited by in corpus (32)

• High-Dimensional Inference: Confidence Intervals, $p$-Values and R-Software hdi
• Valid Post-Selection and Post-Regularization Inference: An Elementary, General Approach
• Linear Hypothesis Testing in Dense High-Dimensional Linear Models
• DoubleML -- An Object-Oriented Implementation of Double Machine Learning in R
• Testability of high-dimensional linear models with non-sparse structures
• Bootstrapping and Sample Splitting For High-Dimensional, Assumption-Free Inference
• Distributed Double Machine Learning with a Serverless Architecture
• A General Framework for Robust Testing and Confidence Regions in High-Dimensional Quantile Regression
• Beyond Gaussian Approximation: Bootstrap for Maxima of Sums of Independent Random Vectors
• Uniform Inference for High-dimensional Quantile Regression: Linear Functionals and Regression Rank Scores
• Confidence regions for high-dimensional generalized linear models under sparsity
• Multiway Cluster Robust Double/Debiased Machine Learning
• De-biased sparse PCA: Inference and testing for eigenstructure of large covariance matrices
• Notes on the dimension dependence in high-dimensional central limit theorems for hyperrectangles
• Subvector Inference in Partially Identified Models with Many Moment Inequalities
• Breaking the curse of dimensionality in regression
• Forward-Selected Panel Data Approach for Program Evaluation
• Many Average Partial Effects: with An Application to Text Regression
• Panel Data Quantile Regression with Grouped Fixed Effects
• Berry-Esseen Bounds for Projection Parameters and Partial Correlations with Increasing Dimension
• Markov Neighborhood Regression for High-Dimensional Inference
• Post-selection inference for linear mixed model parameters using the conditional Akaike information criterion
• Supplementary Appendix for "Inference on Treatment Effects After Selection Amongst High-Dimensional Controls"
• On rank estimators in increasing dimensions
• On the Properties of Simulation-based Estimators in High Dimensions
• Estimation and Inference for Policy Relevant Treatment Effects
• A New Perspective on Debiasing Linear Regressions
• High-dimensional Inference for Dynamic Treatment Effects
• Statistical Inference in High-dimensional Generalized Linear Models with Streaming Data
• Asymptotics of the Empirical Bootstrap Method Beyond Asymptotic Normality
• Model-Assisted Uniformly Honest Inference for Optimal Treatment Regimes in High Dimension
• Post-selection inference on high-dimensional varying-coefficient quantile regression model