Generalization Bounds for Neural Networks via Approximate Description Length

Amit Daniely, Elad Granot

We investigate the sample complexity of networks with bounds on the magnitude of its weights. In particular, we consider the class \[ H=\left\{W_t\circρ\circ \ldots\circρ\circ W_{1…