A Robust Adaptive Stochastic Gradient Method for Deep Learning

Caglar Gulcehre, Jose Sotelo, Marcin Moczulski +1

Stochastic gradient algorithms are the main focus of large-scale optimization problems and led to important successes in the recent advancement of the deep learning algorithms. The…