Randomised Splitting Methods and Stochastic Gradient Descent

Luke Shaw, Peter A. Whalley

We explore an explicit link between stochastic gradient descent using common batching strategies and splitting methods for ordinary differential equations. From this perspective, w…