Investigating the Relationship Between Dropout Regularization and Model Complexity in Neural Networks

Christopher Sun, Jai Sharma, Milind Maiti

Dropout Regularization, serving to reduce variance, is nearly ubiquitous in Deep Learning models. We explore the relationship between the dropout rate and model complexity by train…