Dropout Inference with Non-Uniform Weight Scaling

Zhaoyuan Yang, Arpit Jain

Dropout as regularization has been used extensively to prevent overfitting for training neural networks. During training, units and their connections are randomly dropped, which co…