High-dimension Tensor Completion via Gradient-based Optimization Under Tensor-train Format
arXiv:1804.01983
Abstract
Tensor train (TT) decomposition has drawn people's attention due to its powerful representation ability and performance stability in high-order tensors. In this paper, we propose a novel approach to recover the missing entries of incomplete data represented by higher-order tensors. We attempt to find the low-rank TT decomposition of the incomplete data which captures the latent features of the whole data and then reconstruct the missing entries. By applying gradient descent algorithms, tensor completion problem is efficiently solved by optimization models. We propose two TT-based algorithms: Tensor Train Weighted Optimization (TT-WOPT) and Tensor Train Stochastic Gradient Descent (TT-SGD) to optimize TT decomposition factors. In addition, a method named Visual Data Tensorization (VDT) is proposed to transform visual data into higher-order tensors, resulting in the performance improvement of our algorithms. The experiments in synthetic data and visual data show high efficiency and performance of our algorithms compared to the state-of-the-art completion algorithms, especially in high-order, high missing rate, and large-scale tensor completion situations.
References in corpus (10)
- Adam: A Method for Stochastic Optimization
- An overview of gradient descent optimization algorithms
- Scalable Tensor Factorizations for Incomplete Data
- Tensorizing Neural Networks
- Tensor Ring Decomposition
- Tensor Completion by Alternating Minimization under the Tensor Train (TT) Model
- Efficient tensor completion: Low-rank tensor train
- Learning Efficient Tensor Representations with Ring Structure Networks
- Higher-dimension Tensor Completion via Low-rank Tensor Ring Decomposition
- Tensor Ring Decomposition with Rank Minimization on Latent Space: An Efficient Approach for Tensor Completion