Stochastic gradient algorithms from ODE splitting perspective

Daniil Merkulov, Ivan Oseledets

We present a different view on stochastic optimization, which goes back to the splitting schemes for approximate solutions of ODE. In this work, we provide a connection between sto…