Classifier uncertainty: evidence, potential impact, and probabilistic treatment

Niklas Tötsch, Daniel Hoffmann

Classifiers are often tested on relatively small data sets, which should lead to uncertain performance metrics. Nevertheless, these metrics are usually taken at face value. We pres…