Randomly Initialized One-Layer Neural Networks Make Data Linearly Separable

Promit Ghosal, Srinath Mahankali, Yihang Sun

Recently, neural networks have demonstrated remarkable capabilities in mapping two arbitrary sets to two linearly separable sets. The prospect of achieving this with randomly initi…