Deep Relaxation of Controlled Stochastic Gradient Descent via Singular Perturbations

Martino Bardi, Hicham Kouhkouh

We consider a singularly perturbed system of stochastic differential equations proposed by Chaudhari et al. (Res. Math. Sci. 2018) to approximate the Entropic Gradient Descent in t…