Some theoretical improvements on the tightness of PAC-Bayes risk certificates for neural networks

Diego García-Pérez, Emilio Parrado-Hernández, John Shawe-Taylor

This paper presents four theoretical contributions that improve the usability of risk certificates for neural networks based on PAC-Bayes bounds. First, two bounds on the KL diverg…