Strong inductive biases provably prevent harmless interpolation

Michael Aerni, Marco Milanta, Konstantin Donhauser +1

Classical wisdom suggests that estimators should avoid fitting noise to achieve good generalization. In contrast, modern overparameterized models can yield small test error despite…