The sparse Laplacian shrinkage estimator for high-dimensional regression
arXiv:1112.3450 · doi:10.1214/11-AOS897
Abstract
We propose a new penalized method for variable selection and estimation that explicitly incorporates the correlation patterns among predictors. This method is based on a combination of the minimax concave penalty and Laplacian quadratic associated with a graph as the penalty function. We call it the sparse Laplacian shrinkage (SLS) method. The SLS uses the minimax concave penalty for encouraging sparsity and Laplacian quadratic penalty for promoting smoothness among coefficients associated with the correlated predictors. The SLS has a generalized grouping property with respect to the graph represented by the Laplacian quadratic. We show that the SLS possesses an oracle property in the sense that it is selection consistent and equal to the oracle Laplacian shrinkage estimator with high probability. This result holds in sparse, high-dimensional settings with p >> n under reasonable conditions. We derive a coordinate descent algorithm for computing the SLS estimates. Simulation studies are conducted to evaluate the performance of the SLS method and a real data example is used to illustrate its application.
Published in at http://dx.doi.org/10.1214/11-AOS897 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)
References in corpus (9)
- Nearly unbiased variable selection under minimax concave penalty
- Pathwise coordinate optimization
- On the adaptive elastic-net with a diverging number of parameters
- Coordinate descent algorithms for nonconvex penalized regression, with applications to biological feature selection
- Coordinate descent algorithms for lasso penalized regression
- The sparsity and bias of the Lasso selection in high-dimensional linear regression
- Network exploration via the adaptive LASSO and SCAD penalties
- Variable selection and regression analysis for graph-structured covariates with an application to genomics
- The sparse Laplacian shrinkage estimator for high-dimensional regression
Cited by in corpus (4)
- Correlated variables in regression: clustering and sparse estimation
- The sparse Laplacian shrinkage estimator for high-dimensional regression
- Integrative learning of individualized treatment rules from multiple studies with partially overlapping treatments
- A Network-Guided Penalized Regression with Application to Proteomics Data