Accelerating Single-Point Zeroth-Order Optimization with Regression-Based Gradient Surrogates

Xin Chen, Zhaolin Ren

Zeroth-order optimization (ZO) is widely used for solving black-box optimization and control problems. In particular, single-point ZO (SZO) is well-suited to online or dynamic prob…