Improving Generalization via Uncertainty Driven Perturbations

Matteo Pagliardini, Gilberto Manunza, Martin Jaggi +2

Recently Shah et al., 2020 pointed out the pitfalls of the simplicity bias - the tendency of gradient-based algorithms to learn simple models - which include the model's high sensi…