Expandable Factor Analysis

Abstract

Bayesian sparse factor models have proven useful for characterizing dependence in multivariate data, but scaling computation to large numbers of samples and dimensions is problematic. We propose expandable factor analysis for scalable inference in factor models when the number of factors is unknown. The method relies on a continuous shrinkage prior for efficient maximum a posteriori estimation of a low-rank and sparse loadings matrix. The structure of the prior leads to an estimation algorithm that accommodates uncertainty in the number of factors. We propose an information criterion to select the hyperparameters of the prior. Expandable factor analysis has better false discovery rates and true positive rates than its competitors across diverse simulations. We apply the proposed approach to a gene expression study of aging in mice, illustrating superior results relative to four competing methods.

28 pages, 4 figures

References in corpus (8)

• Nearly unbiased variable selection under minimax concave penalty
• One-step sparse estimates in nonconcave penalized likelihood models
• Statistical analysis of factor models of high dimension
• Nonparametric Bayesian sparse factor models with application to gene expression modeling
• Robust and Scalable Bayes via a Median of Subset Posterior Measures
• Factor modeling for high-dimensional time series: Inference for the number of factors
• Factor models and variable selection in high-dimensional regression analysis
• Sparse estimation via nonconcave penalized likelihood in a factor analysis model

Cited by in corpus (3)

• On the identifiability of Bayesian factor analytic models
• Empirical Bayes Matrix Factorization
• Simple structure estimation via prenet penalization