Robust Kronecker Product PCA for Spatio-Temporal Covariance Estimation
arXiv:1411.1352 · doi:10.1109/TSP.2015.2472364
Abstract
Kronecker PCA involves the use of a space vs. time Kronecker product decomposition to estimate spatio-temporal covariances. In this work the addition of a sparse correction factor is considered, which corresponds to a model of the covariance as a sum of Kronecker products of low (separation) rank and a sparse matrix. This sparse correction extends the diagonally corrected Kronecker PCA of [Greenewald et al 2013, 2014] to allow for sparse unstructured "outliers" anywhere in the covariance matrix, e.g. arising from variables or correlations that do not fit the Kronecker model well, or from sources such as sensor noise or sensor failure. We introduce a robust PCA-based algorithm to estimate the covariance under this model, extending the rearranged nuclear norm penalized LS Kronecker PCA approaches of [Greenewald et al 2014, Tsiligkaridis et al 2013]. An extension to Toeplitz temporal factors is also provided, producing a parameter reduction for temporally stationary measurement modeling. High dimensional MSE performance bounds are given for these extensions. Finally, the proposed extension of KronPCA is evaluated on both simulated and real data coming from yeast cell cycle experiments. This establishes the practical utility of robust Kronecker PCA in biological and other applications.
arXiv commentTo appear in IEEE Transactions on Signal Processing 11 pgs
References in corpus (6)
- Latent variable graphical model selection via convex optimization
- Noisy matrix decomposition via convex relaxation: Optimal rates in high dimensions
- Covariance Estimation in High Dimensions via Kronecker Product Expansions
- Convergence Properties of Kronecker Graphical Lasso Algorithms
- Estimation of Toeplitz Covariance Matrices in Large Dimensional Regime with Application to Source Detection
- Kronecker PCA Based Spatio-Temporal Modeling of Video for Dismount Classification
Cited by in corpus (8)
- Independent component analysis for tensor-valued data
- Incorporating structured assumptions with probabilistic graphical models in fMRI data analysis
- Blind source separation of tensor-valued time series
- JADE for Tensor-Valued Observations
- Integrated Principal Components Analysis
- Scalable Dynamic Mixture Model with Full Covariance for Probabilistic Traffic Forecasting
- Time-dependent spatially varying graphical models, with application to brain fMRI data analysis
- Matrix-normal models for fMRI analysis