Generalization performance of narrow one-hidden layer networks in the teacher-student setting

Rodrigo Pérez Ortiz, Gibbs Nwemadji, Jean Barbier +4

Understanding the generalization properties of neural networks on simple input-output distributions is key to explaining their performance on real datasets. The classical teacher-s…