Sparse logistic principal components analysis for binary data

Abstract

We develop a new principal components analysis (PCA) type dimension reduction method for binary data. Different from the standard PCA which is defined on the observed data, the proposed PCA is defined on the logit transform of the success probabilities of the binary observations. Sparsity is introduced to the principal component (PC) loading vectors for enhanced interpretability and more stable extraction of the principal components. Our sparse PCA is formulated as solving an optimization problem with a criterion function motivated from a penalized Bernoulli likelihood. A Majorization--Minimization algorithm is developed to efficiently solve the optimization problem. The effectiveness of the proposed sparse logistic PCA method is illustrated by application to a single nucleotide polymorphism data set and a simulation study.

Published in at http://dx.doi.org/10.1214/10-AOAS327 the Annals of Applied Statistics (http://www.imstat.org/aoas/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (4)

• On the "degrees of freedom" of the lasso
• Variable selection using MM algorithms
• Sparse logistic principal components analysis for binary data
• Statistical advances and challenges for analyzing correlated high dimensional SNP data in genomic study for complex diseases

Cited by in corpus (20)

• Classification and clustering of sequencing data using a Poisson model
• Dimensionality Reduction for Binary Data through the Projection of Natural Parameters
• Sparse logistic principal components analysis for binary data
• Calibrating an ice sheet model using high-dimensional binary spatial data
• Conditionally conjugate mean-field variational Bayes for logistic models
• Sparse principal component regression with adaptive loading
• Sparse and Functional Principal Components Analysis
• Robust Parametric Classification and Variable Selection by a Minimum Distance Criterion
• Robust regularized singular value decomposition with application to mortality data
• Online Categorical Subspace Learning for Sketching Big Data with Misses
• Learning from Binary Multiway Data: Probabilistic Tensor Decomposition and its Statistical Optimality
• Sparse principal component regression via singular value decomposition approach
• Sparse Factor Analysis for Learning and Content Analytics
• A Hierarchical Framework for State Space Matrix Inference and Clustering
• A lower bound for the ELBO of the Bernoulli Variational Autoencoder
• Model-based clustering of multivariate binary data with dimension reduction
• Sparse Generalized Principal Component Analysis for Large-scale Applications beyond Gaussianity
• A Generalised Linear Model Framework for $\beta$-Variational Autoencoders based on Exponential Dispersion Families
• Sparse Logistic Tensor Decomposition for Binary Data
• Sparse logistic functional principal component analysis for binary data