Accelerating Block Coordinate Descent for Nonnegative Tensor Factorization
arXiv:2001.04321 · doi:10.1002/nla.2373
Abstract
This paper is concerned with improving the empirical convergence speed of block-coordinate descent algorithms for approximate nonnegative tensor factorization (NTF). We propose an extrapolation strategy in-between block updates, referred to as heuristic extrapolation with restarts (HER). HER significantly accelerates the empirical convergence speed of most existing block-coordinate algorithms for dense NTF, in particular for challenging computational scenarios, while requiring a negligible additional computational budget.
arXiv comment32 pages, 24 figures
References in corpus (15)
- Tensor Decomposition for Signal Processing and Machine Learning
- Tensor Decompositions for Signal Processing Applications From Two-way to Multiway Component Analysis
- A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights
- On Tensors, Sparsity, and Nonnegative Factorizations
- The Why and How of Nonnegative Matrix Factorization
- Nonnegative Matrix Factorization for Signal and Data Analytics: Identifiability, Algorithms, and Applications
- Accelerated Multiplicative Updates and Hierarchical ALS Algorithms for Nonnegative Matrix Factorization
- A Flexible and Efficient Algorithmic Framework for Constrained Matrix and Tensor Factorization
- A Practical Randomized CP Tensor Decomposition
- Canonical polyadic decomposition of third-order tensors: reduction to generalized eigenvalue decomposition
- Accelerating Nonnegative Matrix Factorization Algorithms using Extrapolation
- A condition number for the tensor rank decomposition
- Pencil-based algorithms for tensor rank decomposition are not stable
- Accelerating Block Coordinate Descent for Nonnegative Tensor Factorization
- About Notations in Multiway Array Processing
Cited by in corpus (4)
- Computing Large-Scale Matrix and Tensor Decomposition with Structured Factors: A Unified Nonconvex Optimization Perspective
- Accelerating Block Coordinate Descent for Nonnegative Tensor Factorization
- Bounded Simplex-Structured Matrix Factorization: Algorithms, Identifiability and Applications
- Representation Theorem for Matrix Product States