14 citations · 24 across the 13 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
stat.ML2024
Gradient Span Algorithms Make Predictable Progress in High Dimension
Felix Benning, Leif Döring
We prove that all 'gradient span algorithms' have asymptotically deterministic behavior on scaled Gaussian random functions as the dimension tends to infinity. This is a functional…
cs.LG2024
Almost sure convergence rates of stochastic gradient methods under gradient domination
Simon Weissmann, Sara Klein, Waïss Azizian +1
Stochastic gradient methods are among the most important algorithms in training machine learning problems. While classical assumptions such as strong convexity allow a simple analy…