3 citations · 3 across the 2 of their papers we have counts for
2 papers
cs.LG2024
Where Do Large Learning Rates Lead Us?
Ildus Sadrtdinov, Maxim Kodryan, Eduard Pokonechny +2
It is generally accepted that starting neural networks training with large learning rates (LRs) improves generalization. Following a line of research devoted to understanding this…
cs.LG2022★ 3 cited
Neural Tangent Kernel: A Survey
Eugene Golikov, Eduard Pokonechnyy, Vladimir Korviakov
A seminal work [Jacot et al., 2018] demonstrated that training a neural network under specific parameterization is equivalent to performing a particular kernel method as width goes…