On the role of data in PAC-Bayes bounds

Gintare Karolina Dziugaite, Kyle Hsu, Waseem Gharbieh +2

The dominant term in PAC-Bayes bounds is often the Kullback--Leibler divergence between the posterior and prior. For so-called linear PAC-Bayes risk bounds based on the empirical r…