Towards Continuous-Time Approximations for Stochastic Gradient Descent without Replacement

Stefan Perko

Gradient optimization algorithms using epochs, that is those based on stochastic gradient descent without replacement (SGDo), are predominantly used to train machine learning model…