Double Adaptive Stochastic Gradient Optimization

Kin Gutierrez, Jin Li, Cristian Challu +1

Adaptive moment methods have been remarkably successful in deep learning optimization, particularly in the presence of noisy and/or sparse gradients. We further the advantages of a…