2 citations · 2 across the 3 of their papers we have counts for
3 papers
Convergence of the Iterates for Momentum and RMSProp for Local Smooth Functions: Adaptation is the Key
Bilel Bensaid, Gaël Poëtte, Rodolphe Turpault
Both accelerated and adaptive gradient methods are among state of the art algorithms to train neural networks. The tuning of hyperparameters is needed to make them work efficiently…
An Abstract Lyapunov Control Optimizer: Local Stabilization and Global Convergence
Bilel Bensaid, Gaël Poëtte, Rodolphe Turpault
Recently, many machine learning optimizers have been analysed considering them as the asymptotic limit of some differential equations when the step size goes to zero. In other word…
Late-time/stiff relaxation asymptotic-preserving approximations of hyperbolic equations
Christophe Berthon, Philippe G. LeFloch, Rodolphe Turpault
We investigate the late-time asymptotic behavior of solutions to nonlinear hyperbolic systems of conservation laws containing stiff relaxation terms. First, we introduce a Chapman-…