Fundamental limits of overparametrized shallow neural networks for supervised learning

Francesco Camilli, Daria Tieplova, Jean Barbier

We carry out an information-theoretical analysis of a two-layer neural network trained from input-output pairs generated by a teacher network with matching architecture, in overpar…