Mitigating Bias in Calibration Error Estimation

Rebecca Roelofs, Nicholas Cain, Jonathon Shlens +1

For an AI system to be reliable, the confidence it expresses in its decisions must match its accuracy. To assess the degree of match, examples are typically binned by confidence an…