The Geometry of Over-parameterized Regression and Adversarial Perturbations

Jason W. Rocks, Pankaj Mehta

Classical regression has a simple geometric description in terms of a projection of the training labels onto the column space of the design matrix. However, for over-parameterized…