Self-Balanced Dropout

Shen Li, Chenhao Su, Renfen Hu +1

Dropout is known as an effective way to reduce overfitting via preventing co-adaptations of units. In this paper, we theoretically prove that the co-adaptation problem still exists…