The Map Behind the Flow: Finite-Step Gradient Descent as a Dynamical System

Thomas Hofmann

Many phenomena of deep learning are dynamical: they concern not only which minima exist, but how gradient descent reaches, avoids, or selects among them. Edge-of-stability behavior…