Minimax Efficient Finite-Difference Stochastic Gradient Estimators Using Black-Box Function Evaluations

Henry Lam, Haidong Li, Xuhui Zhang

Standard approaches to stochastic gradient estimation, with only noisy black-box function evaluations, use the finite-difference method or its variants. While natural, it is open t…