Dimension-Free Rank Lifting from Random Hyperplane Arrangements

Luca Becchetti, Matteo Russo, Ruben Skorupinski

We study the width required for a randomly initialized hidden layer of a neural network to achieve rank lifting. Namely, given a dataset $X\in {\mathbb{R}}^{m\times d}$ of $m$, $d$…