Second-Moment Stochastic Approximation Methods

Tao Jiang, Lin Xiao

Classical stochastic approximation methods rely on estimators of the first moment (mean) of a random regression function. We study methods that employ estimators of both the first…