Global Convergence and Acceleration for Single Observation Gradient Free Optimization

Caio Kalil Lauand, Sean Meyn

Simultaneous perturbation stochastic approximation (SPSA) is an approach to gradient-free optimization introduced by Spall as a simplification of the approach of Kiefer and Wolfowi…