Optimal sampling for stochastic and natural gradient descent

Robert Gruhlke, Anthony Nouy, Philipp Trunschke

We consider the problem of optimising the expected value of a loss functional over a nonlinear model class of functions, assuming that we have only access to realisations of the gr…