Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problem

Matthias Hein, Maksym Andriushchenko, Julian Bitterwolf

Classifiers used in the wild, in particular for safety-critical systems, should not only have good generalization properties but also should know when they don't know, in particula…