Dropout is a special case of the stochastic delta rule: faster and more accurate deep learning

Noah Frazier-Logue, Stephen José Hanson

Multi-layer neural networks have lead to remarkable performance on many kinds of benchmark tasks in text, speech and image processing. Nonlinear parameter estimation in hierarchica…