What is Your Metric Telling You? Evaluating Classifier Calibration under Context-Specific Definitions of Reliability

John Kirchenbauer, Jacob Oaks, Eric Heim

Classifier calibration has received recent attention from the machine learning community due both to its practical utility in facilitating decision making, as well as the observati…