Escaping Saddle Points Efficiently with Occupation-Time-Adapted Perturbations

Xin Guo, Jiequn Han, Mahan Tajrobehkar +1

Motivated by the super-diffusivity of self-repelling random walk, which has roots in statistical physics, this paper develops a new perturbation mechanism for optimization algorith…