Gradient Regularization Improves Accuracy of Discriminative Models

Dániel Varga, Adrián Csiszárik, Zsolt Zombori

Regularizing the gradient norm of the output of a neural network with respect to its inputs is a powerful technique, rediscovered several times. This paper presents evidence that g…