Pairwise Margin Maximization for Deep Neural Networks

Berry Weinstein, Shai Fine, Yacov Hel-Or

The weight decay regularization term is widely used during training to constrain expressivity, avoid overfitting, and improve generalization. Historically, this concept was borrowe…