PAC-Bayes Bounds for Gibbs Posteriors via Singular Learning Theory

Chenyang Wang, Yun Yang

We derive explicit non-asymptotic PAC-Bayes generalization bounds for Gibbs posteriors, that is, data-dependent distributions over model parameters obtained by exponentially tiltin…