Gradient-Coherent Strong Regularization for Deep Neural Networks

Dae Hoon Park, Chiu Man Ho, Yi Chang +1

Regularization plays an important role in generalization of deep neural networks, which are often prone to overfitting with their numerous parameters. L1 and L2 regularizers are co…