Gradient Span Algorithms Make Predictable Progress in High Dimension

Felix Benning, Leif Döring

We prove that all 'gradient span algorithms' have asymptotically deterministic behavior on scaled Gaussian random functions as the dimension tends to infinity. This is a functional…