Semi-parametric TEnsor Factor Analysis by Iteratively Projected Singular Value Decomposition
arXiv:2007.02404 · doi:10.1093/jrsssb/qkae001
Abstract
This paper introduces a general framework of Semi-parametric TEnsor Factor Analysis (STEFA) that focuses on the methodology and theory of low-rank tensor decomposition with auxiliary covariates. Semi-parametric TEnsor Factor Analysis models extend tensor factor models by incorporating auxiliary covariates in the loading matrices. We propose an algorithm of iteratively projected singular value decomposition (IP-SVD) for the semi-parametric estimation. It iteratively projects tensor data onto the linear space spanned by the basis functions of covariates and applies singular value decomposition on matricized tensors over each mode. We establish the convergence rates of the loading matrices and the core tensor factor. The theoretical results only require a sub-exponential noise distribution, which is weaker than the assumption of sub-Gaussian tail of noise in the literature. Compared with the Tucker decomposition, IP-SVD yields more accurate estimators with a faster convergence rate. Besides estimation, we propose several prediction methods with new covariates based on the STEFA model. On both synthetic and real tensor data, we demonstrate the efficacy of the STEFA model and the IP-SVD algorithm on both the estimation and prediction tasks.
44 pages, 8 figures
References in corpus (9)
- Statistical analysis of factor models of high dimension
- Statistical Inference for High-Dimensional Matrix-Variate Factor Model
- Factor modeling for high-dimensional time series: Inference for the number of factors
- Rank Determination in Tensor Factor Model
- Regularized Tensor Factorizations and Higher-Order Principal Components Analysis
- Tensor Factor Model Estimation by Iterative Projection
- Supervised tensor decomposition with features on multiple modes
- Modeling Multivariate Spatial-Temporal Data with Latent Low-Dimensional Dynamics
- Discussion: Conditional growth charts