Learning from Randomly Initialized Neural Network Features

Ehsan Amid, Rohan Anil, Wojciech Kotłowski +1

We present the surprising result that randomly initialized neural networks are good feature extractors in expectation. These random features correspond to finite-sample realization…