Langevin algorithms for Markovian Neural Networks and Deep Stochastic control

Pierre Bras, Gilles Pagès

Stochastic Gradient Descent Langevin Dynamics (SGLD) algorithms, which add noise to the classic gradient descent, are known to improve the training of neural networks in some cases…