Introduction to stochastic gradient methods

Simon Weissmann

These lecture notes provide an introduction to first-order optimization methods with a particular emphasis on stochastic gradient methods. We begin with deterministic gradient base…