Non-Vacuous Generalization Bounds: Can Rescaling Invariances Help?

Damien Rouchouse, Antoine Gonon, Rémi Gribonval +1

A central challenge in understanding generalization is to obtain non-vacuous guarantees that go beyond worst-case complexity over data or weight space. Among existing approaches, P…