Asymptotic oracle properties of SCAD-penalized least squares estimators

Abstract

We study the asymptotic properties of the SCAD-penalized least squares estimator in sparse, high-dimensional, linear regression models when the number of covariates may increase with the sample size. We are particularly interested in the use of this estimator for simultaneous variable selection and estimation. We show that under appropriate conditions, the SCAD-penalized least squares estimator is consistent for variable selection and that the estimators of nonzero coefficients have the same asymptotic distribution as they would have if the zero coefficients were known in advance. Simulation studies indicate that this estimator performs well in terms of variable selection and estimation.

arXiv commentPublished at http://dx.doi.org/10.1214/074921707000000337 in the IMS Lecture Notes Monograph Series (http://www.imstat.org/publications/lecnotes.htm) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (2)

• Nonconcave penalized likelihood with a diverging number of parameters
• Asymptotic properties of bridge estimators in sparse high-dimensional regression models

Cited by in corpus (7)

• Bayesian variable selection with shrinking and diffusing priors
• Variable selection and regression analysis for graph-structured covariates with an application to genomics
• Consistent selection of tuning parameters via variable selection stability
• Model selection and structure specification in ultra-high dimensional generalised semi-varying coefficient models
• Scalable Bayesian Variable Selection Using Nonlocal Prior Densities in Ultrahigh-Dimensional Settings
• High-dimensional structure learning of sparse vector autoregressive models using fractional marginal pseudo-likelihood
• Weak Signal Identification and Inference in Penalized Model Selection