Scaling up Stochastic Gradient Descent for Non-convex Optimisation

Saad Mohamad, Hamad Alamri, Abdelhamid Bouchachia

Stochastic gradient descent (SGD) is a widely adopted iterative method for optimizing differentiable objective functions. In this paper, we propose and discuss a novel approach to…