47 citations · 47 across the 8 of their papers we have counts for
Showing 2024Show all
3 papers · 1 filter
cs.LG2024
SGD with memory: fundamental properties and stochastic acceleration
Dmitry Yarotsky, Maksim Velikanov
An important open problem is the theoretically feasible acceleration of mini-batch SGD-type algorithms on quadratic problems with power-law spectrum. In the non-stochastic setting,…
cs.LG2024
Generalization error of spectral algorithms
Maksim Velikanov, Maxim Panov, Dmitry Yarotsky
The asymptotically precise estimation of the generalization of kernel methods has recently received attention due to the parallels between neural networks and their associated kern…
stat.ML2024
Learnability of high-dimensional targets by two-parameter models and gradient flow
Dmitry Yarotsky
We explore the theoretical possibility of learning -dimensional targets with -parameter models by gradient flow (GF) when . Our main result shows that if the targets are…