A Geometric Approach of Gradient Descent Algorithms in Linear Neural Networks

Yacine Chitour, Zhenyu Liao, Romain Couillet

In this paper, we propose a geometric framework to analyze the convergence properties of gradient descent trajectories in the context of linear neural networks. We translate a well…