Implicitly Maximizing Margins with the Hinge Loss

Justin Lizama

A new loss function is proposed for neural networks on classification tasks which extends the hinge loss by assigning gradients to its critical points. We will show that for a line…