Tangent-Space Gradient Optimization of Tensor Network for Machine Learning

Zheng-zhi Sun, Shi-ju Ran, Gang Su

The gradient-based optimization method for deep machine learning models suffers from gradient vanishing and exploding problems, particularly when the computational graph becomes de…