Differentiable PAC-Bayes Objectives with Partially Aggregated Neural Networks

Felix Biggs, Benjamin Guedj

We make three related contributions motivated by the challenge of training stochastic neural networks, particularly in a PAC-Bayesian setting: (1) we show how averaging over an ens…