Almost Sure Convergence of Dropout Algorithms for Neural Networks

Albert Senen-Cerda, Jaron Sanders

We investigate the convergence and convergence rate of stochastic training algorithms for Neural Networks (NNs) that have been inspired by Dropout (Hinton et al., 2012). With the g…