Stochastic Gradient Optimization with Model-Assisted Sampling

Jonne Pohjankukka, Jukka Heikkonen

This work addresses the problem of variance in stochastic gradient estimation for machine learning optimization. Deep learning relies on mini-batch methods such as stochastic gradi…