248 citations · 651 across the 15 of their papers we have counts for
Showing 2023 · stat.MLShow all
2 papers · 2 filters
stat.ML2023
Implicit regularisation in stochastic gradient descent: from single-objective to two-player games
Mihaela Rosca, Marc Peter Deisenroth
Recent years have seen many insights on deep learning optimisation being brought forward by finding implicit regularisation effects of commonly used gradient-based optimisers. Unde…
stat.ML2023★ 1 cited
On a continuous time model of gradient descent dynamics and instability in deep learning
Mihaela Rosca, Yan Wu, Chongli Qin +1
The recipe behind the success of deep learning has been the combination of neural networks and gradient-based optimization. Understanding the behavior of gradient descent however,…