Regularized and Smooth Double Core Tensor Factorization for Heterogeneous Data
arXiv:1911.10454
Abstract
We introduce a general tensor model suitable for data analytic tasks for {\em heterogeneous} datasets, wherein there are joint low-rank structures within groups of observations, but also discriminative structures across different groups. To capture such complex structures, a double core tensor (DCOT) factorization model is introduced together with a family of smoothing loss functions. By leveraging the proposed smoothing function, the model accurately estimates the model factors, even in the presence of missing entries. A linearized ADMM method is employed to solve regularized versions of DCOT factorizations, that avoid large tensor operations and large memory storage requirements. Further, we establish theoretically its global convergence, together with consistency of the estimates of the model parameters. The effectiveness of the DCOT model is illustrated on several real-world examples including image completion, recommender systems, subspace clustering and detecting modules in heterogeneous Omics multi-modal data, since it provides more insightful decompositions than conventional tensor methods.
arXiv comment49 pages, 4 figures
References in corpus (13)
- Tensor Decomposition for Signal Processing and Machine Learning
- Tensor Decompositions for Signal Processing Applications From Two-way to Multiway Component Analysis
- Joint and individual variation explained (JIVE) for integrated analysis of multiple data types
- Parallel matrix factorization for low-rank tensor completion
- On Tensors, Sparsity, and Nonnegative Factorizations
- Unbiased Risk Estimates for Singular Value Thresholding and Spectral Estimators
- All-at-once Optimization for Coupled Matrix and Tensor Factorizations
- Generalized Canonical Polyadic Tensor Decomposition
- Convex Tensor Decomposition via Structured Schatten Norm Regularization
- Minimax Lower Bounds on Dictionary Learning for Tensor Data
- Supervised multiway factorization
- GIFT: Guided and Interpretable Factorization for Tensors - An Application to Large-Scale Multi-platform Cancer Analysis
- Adaptive First-and Zeroth-order Methods for Weakly Convex Stochastic Optimization Problems