Overparametrized linear dimensionality reductions: From projection pursuit to two-layer neural networks

Andrea Montanari, Kangjie Zhou

Given a cloud of $n$ data points in ${\mathbb{R}}^d$, consider all projections onto $m$-dimensional subspaces of ${\mathbb{R}}^d$ and, for each such projection, the empirical distribut…