Corner Gradient Descent

Dmitry Yarotsky

We consider SGD-type optimization on infinite-dimensional quadratic problems with power law spectral conditions. It is well-known that on such problems deterministic GD has loss co…