Approximate Gaussianity Beyond Initialisation in Neural Networks

Edward Hirst, Sanjaye Ramgoolam

Ensembles of neural network weight matrices are studied through the training process for the MNIST classification problem, testing the efficacy of matrix models for representing th…