Pivotal Estimation via Self-Normalization for High-Dimensional Linear Models with Error in Variables
arXiv:1708.08353
Abstract
We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the choice of penalty parameters is pivotal. The estimator is based on applying a self-normalization to the constraints that characterize the estimator. Importantly, we show how to cast the computation of the estimator as the solution of a convex program with second order cone constraints. This allows the use of algorithms with theoretical guarantees and reliable implementation. Under sparsity assumptions, we derive -rates of convergence and show that consistency can be achieved even if the number of regressors exceeds the sample size. We further provide a simple to implement rule to threshold the estimator that yields a provably sparse estimator with similar and -rates of convergence. The thresholds are data-driven and component dependents. Finally, we also study the rates of convergence of estimators that refit the data based on a selected support with possible model selection mistakes. In addition to our finite sample theoretical results that allow for non-i.i.d. data, we also present simulations to compare the performance of the proposed estimators.
References in corpus (10)
- Simultaneous analysis of Lasso and Dantzig selector
- Square-Root Lasso: Pivotal Recovery of Sparse Signals via Conic Programming
- High-dimensional regression with noisy and missing data: Provable guarantees with nonconvexity
- Sparse recovery under matrix uncertainty
- High-dimensional instrumental variables regression and confidence sets
- Measurement Error in Lasso: Impact and Correction
- Orthogonal Matching Pursuit with Noisy and Missing Data: Low and High Dimensional Results
- Two Stage Non-penalized Corrected Least Squares for High Dimensional Linear Models with Measurement error or Missing Covariates
- High dimensional errors-in-variables models with dependent measurements
- CoCoLasso for High-dimensional Error-in-variables Regression
Cited by in corpus (7)
- On Robustness of Principal Component Regression
- Inference on the Change Point for High Dimensional Dynamic Graphical Models
- High-dimensional Log-Error-in-Variable Regression with Applications to Microbial Compositional Data Analysis
- Detection and estimation of parameters in high dimensional multiple change point regression models via regularization and discrete optimization
- Segmentation of high dimensional means over multi-dimensional change points and connections to regression trees
- Imputation for High-Dimensional Linear Regression
- Inference on the change point in high dimensional time series models via plug in least squares