Deterministic Denominator Design for Localized Tamed Stochastic Gradient Langevin Dynamics

Yiwei Zhou, Ziheng Chen

If the denominator in a tamed stochastic gradient Langevin update uses the current stochastic-gradient draw, the conditional mean can be biased even when the stochastic-gradient or…