Inference for Heteroskedastic PCA with Missing Data
arXiv:2107.12365
Abstract
This paper studies how to construct confidence regions for principal component analysis (PCA) in high dimension, a problem that has been vastly under-explored. While computing measures of uncertainty for nonlinear/nonconvex estimators is in general difficult in high dimension, the challenge is further compounded by the prevalent presence of missing data and heteroskedastic noise. We propose a novel approach to performing valid inference on the principal subspace under a spiked covariance model with missing data, on the basis of an estimator called HeteroPCA (Zhang et al., 2022). We develop non-asymptotic distributional guarantees for HeteroPCA, and demonstrate how these can be invoked to compute both confidence regions for the principal subspace and entrywise confidence intervals for the spiked covariance matrix. Our inference procedures are fully data-driven and adaptive to heteroskedastic random noise, without requiring prior knowledge about the noise levels.
accepted to Annals of Statistics
References in corpus (17)
- Confidence Intervals and Hypothesis Testing for High-Dimensional Regression
- High-dimensional regression with noisy and missing data: Provable guarantees with nonconvexity
- Restricted strong convexity and weighted matrix completion: Optimal bounds with noise
- Nonconvex Optimization Meets Low-Rank Matrix Factorization: An Overview
- Guaranteed Matrix Completion via Non-convex Factorization
- Implicit Regularization in Nonconvex Statistical Estimation: Gradient Descent Converges Linearly for Phase Retrieval, Matrix Completion, and Blind Deconvolution
- Asymptotic normality and optimalities in estimation of large Gaussian graphical models
- Fast low-rank estimation by projected gradient descent: General statistical and algorithmic guarantees
- Inference and Uncertainty Quantification for Noisy Matrix Completion
- Convergence Analysis for Rectangular Matrix Completion Using Burer-Monteiro Factorization and Gradient Descent
- The Lasso with general Gaussian designs with applications to hypothesis testing
- Recent Developments on Factor Models and its Applications in Econometric Learning
- Entrywise Estimation of Singular Vectors of Low-Rank Matrices with Heteroskedasticity and Dependence
- Singular vector and singular subspace distribution for the matrix denoising model
- Uncertainty quantification for nonconvex tensor completion: Confidence intervals, heteroscedasticity and optimality
- Adapting to Unknown Noise Distribution in Matrix Denoising
- Minimax Estimation of Linear Functions of Eigenvectors in the Face of Small Eigen-Gaps