Incorruptible Neural Networks: Training Models that can Generalize to Large Internal Perturbations

Philip Jacobson, Ben Feinberg, Suhas Kumar +3

Flat regions of the neural network loss landscape have long been hypothesized to correlate with better generalization properties. A closely related but distinct problem is training…