Information-Theoretic Generalization Bounds for Deep Neural Networks

Haiyun He, Ziv Goldfeld

Deep neural networks (DNNs) exhibit an exceptional capacity for generalization in practical applications. This work aims to capture the effect and benefits of depth for supervised…