Improving Deep Neural Network Random Initialization Through Neuronal Rewiring

Leonardo Scabini, Bernard De Baets, Odemir M. Bruno

The deep learning literature is continuously updated with new architectures and training techniques. However, weight initialization is overlooked by most recent research, despite s…