Stochastic Zeroth-Order Optimization Under Heavy-Tailed Noise

Taha El Bakkali, El Mahdi Chayti, Qiuyi Zhang +2

We study stochastic zeroth-order (ZO) optimization of smooth nonconvex objectives under heavy-tailed sample-gradient noise. This regime is motivated by empirical evidence that grad…