Adaptive Gradient Method with Resilience and Momentum

Jie Liu, Chen Lin, Chuming Li +4

Several variants of stochastic gradient descent (SGD) have been proposed to improve the learning effectiveness and efficiency when training deep neural networks, among which some r…