Nonasymptotic theory for two-layer neural networks: Beyond the bias-variance trade-off

Huiyuan Wang, Wei Lin

Large neural networks have proved remarkably effective in modern deep learning practice, even in the overparametrized regime where the number of active parameters is large relative…