Scalable Natural Gradient Langevin Dynamics in Practice

Henri Palacci, Henry Hess

Stochastic Gradient Langevin Dynamics (SGLD) is a sampling scheme for Bayesian modeling adapted to large datasets and models. SGLD relies on the injection of Gaussian Noise at each…