diffGrad: An Optimization Method for Convolutional Neural Networks

Shiv Ram Dubey, Soumendu Chakraborty, Swalpa Kumar Roy +3

Stochastic Gradient Decent (SGD) is one of the core techniques behind the success of deep neural networks. The gradient provides information on the direction in which a function ha…