Linear discriminant initialization for feed-forward neural networks

Marissa Masden, Dev Sinha

Informed by the basic geometry underlying feed forward neural networks, we initialize the weights of the first layer of a neural network using the linear discriminants which best d…