The Restricted Isometry of ReLU Networks: Generalization through Norm Concentration

Alex Goeßmann, Gitta Kutyniok

While regression tasks aim at interpolating a relation on the entire input space, they often have to be solved with a limited amount of training data. Still, if the hypothesis func…