Is SGD a Bayesian sampler? Well, almost

Chris Mingard, Guillermo Valle-Pérez, Joar Skalse +1

Overparameterised deep neural networks (DNNs) are highly expressive and so can, in principle, generate almost any function that fits a training dataset with zero error. The vast ma…