Regularizing Neural Networks by Stochastically Training Layer Ensembles

Alex Labach, Shahrokh Valaee

Dropout and similar stochastic neural network regularization methods are often interpreted as implicitly averaging over a large ensemble of models. We propose STE (stochastically t…