Exponential Concentration in Stochastic Approximation

Kody Law, Neil Walton, Shangda Yang

We analyze the behavior of stochastic approximation algorithms where iterates, in expectation, progress towards an objective at each step. When progress is proportional to the step…