Deterministic parallel analysis: An improved method for selecting factors and principal components

Abstract

Factor analysis and principal component analysis (PCA) are used in many application areas. The first step, choosing the number of components, remains a serious challenge. Our work proposes improved methods for this important problem. One of the most popular state-of-the-art methods is Parallel Analysis (PA), which compares the observed factor strengths to simulated ones under a noise-only model. This paper proposes improvements to PA. We first de-randomize it, proposing Deterministic Parallel Analysis (DPA), which is faster and more reproducible than PA. Both PA and DPA are prone to a shadowing phenomenon in which a strong factor makes it hard to detect smaller but more interesting factors. We propose deflation to counter shadowing. We also propose to raise the decision threshold to improve estimation accuracy. We prove several consistency results for our methods, and test them in simulations. We also illustrate our methods on data from the Human Genome Diversity Project, where they significantly improve the accuracy.

Made title consistent with published version

References in corpus (2)

• Statistical analysis of factor models of high dimension
• Multiple hypothesis testing adjusted for latent variables, with an application to the AGEMAP gene expression data

Cited by in corpus (5)

• ScreeNOT: Exact MSE-Optimal Singular Value Thresholding in Correlated Noise
• Biwhitening Reveals the Rank of a Count Matrix
• Optimal spectral shrinkage and PCA with heteroscedastic noise
• Denoising Click-evoked Otoacoustic Emission Signals by Optimal Shrinkage
• A Spectral Method for Identifiable Grade of Membership Analysis with Binary Responses