2 papers
math.OC2025
prunAdag: an adaptive pruning-aware gradient method
Margherita Porcelli, Giovanni Seraghiti, Philippe L. Toint
A pruning-aware adaptive gradient method is proposed which classifies the variables in two sets before updating them using different strategies. This technique extends the ``releva…
math.OC2024
Examples of slow convergence for adaptive regularization optimization methods are not isolated
Philippe L. Toint
The adaptive regularization algorithm for unconstrained nonconvex optimization was shown in Nesterov and Polyak (2006) and Cartis, Gould and Toint (2011) to require, under standard…