6 citations · 14 across the 20 of their papers we have counts for
4 papers · 1 filter
Stochastic convergence of parallel asynchronous adaptive first-order methods
Serge Gratton, Philippe L. Toint
A new class of asynchronous adaptive first-order optimization methods is introduced, comprising asynchronous variants of several popular algorithms. Versions of these methods using…
A unified convergence theory for adaptive first-order methods in the nonconvex case, including AdaNorm, full and diagonal AdaGrad and Muon
S. Gratton, Ph. L. Toint
A unified framework for first-order optimization algorithms fornonconvex unconstrained optimization is proposed that uses adaptivelypreconditioned gradients and includes popular me…
An objective-function-free algorithm for nonconvex stochastic optimization with deterministic equality and inequality constraints
S. Gratton, Ph. L. Toint
An algorithm is proposed for solving optimization problems with stochastic objective and deterministic equality and inequality constraints. This algorithm is objective-function-fre…
Iteration complexity of the Difference-of-Convex Algorithm for unconstrained optimization: a simple proof
Serge Gratton, Philippe L. Toint
We propose a simple proof of the worst-case iteration complexity for the Difference of Convex functions Algorithm (DCA) for unconstrained minimization, showing that the global rate…