On the Inductive Bias of Dropout

David P. Helmbold, Philip M. Long

Dropout is a simple but effective technique for learning in neural networks and other settings. A sound theoretical understanding of dropout is needed to determine when dropout sho…