Dropout Neural Network Training Viewed from a Percolation Perspective

Finley Devlin, Jaron Sanders

In this work, we investigate the existence and effect of percolation in training deep Neural Networks (NNs) with dropout. Dropout methods are regularisation techniques for training…