Sparse principal component regression via singular value decomposition approach
arXiv:2002.09188 · doi:10.1007/s11634-020-00435-2
Abstract
Principal component regression (PCR) is a two-stage procedure: the first stage performs principal component analysis (PCA) and the second stage constructs a regression model whose explanatory variables are replaced by principal components obtained by the first stage. Since PCA is performed by using only explanatory variables, the principal components have no information about the response variable. To address the problem, we propose a one-stage procedure for PCR in terms of singular value decomposition approach. Our approach is based upon two loss functions, a regression loss and a PCA loss, with sparse regularization. The proposed method enables us to obtain principal component loadings that possess information about both explanatory variables and a response variable. An estimation algorithm is developed by using alternating direction method of multipliers. We conduct numerical studies to show the effectiveness of the proposed method.
arXiv comment30 pages
References in corpus (21)
- Discussion of "Least angle regression" by Efron et al
- Rejoinder to "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Least Angle Regression
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Nearly unbiased variable selection under minimax concave penalty
- Pathwise coordinate optimization
- Coordinate descent algorithms for lasso penalized regression
- Sparse Principal Component Analysis via Variable Projection
- Sparse logistic principal components analysis for binary data
- Learning Graphical Models With Hubs
- Sparse Convex Clustering
- Sparse principal component regression with adaptive loading
- Sparse principal component regression for generalized linear models
- An Alternating Manifold Proximal Gradient Method for Sparse PCA and Sparse CCA
- Sparse PCA from Sparse Linear Regression