A qualitative difference between gradient flows of convex functions in finite- and infinite-dimensional Hilbert spaces

Jonathan W. Siegel, Stephan Wojtowytsch

We consider gradient flow/gradient descent and heavy ball/accelerated gradient descent optimization for convex objective functions. In the gradient flow case, we prove the followin…