Dropout Drops Double Descent

Tian-Le Yang, Joe Suzuki

This study demonstrates that double descent can be mitigated by adding a dropout layer adjacent to the fully connected linear layer. The unexpected double-descent phenomenon garner…