Fast Stochastic Second-Order Adagrad for Nonconvex Bound-Constrained Optimization

S. Bellavia, S. Gratton, B. Morini +1

ADAGB2, a generalization of the Adagrad algorithm for stochastic optimization is introduced, which is also applicable to bound-constrained problems and capable of using second-orde…