Online Learning for the Random Feature Model in the Student-Teacher Framework

Roman Worschech, Bernd Rosenow

Deep neural networks are widely used prediction algorithms whose performance often improves as the number of weights increases, leading to over-parametrization. We consider a two-l…