Global Convergence and Error Propagation in Neural Gradient Flows: A Riemannian Optimization Framework

Shixin Zheng, Yiwei Wang, Haizhao Yang

We develop a geometric convergence theory for neural-network optimization within the minimizing movement scheme (MMS) framework. Reformulating each neural MMS step as a minimizatio…