Zeroth-order non-convex learning via hierarchical dual averaging

Amélie Héliou, Matthieu Martin, Panayotis Mertikopoulos +1

We propose a hierarchical version of dual averaging for zeroth-order online non-convex optimization - i.e., learning processes where, at each stage, the optimizer is facing an unkn…