Quantifying Uncertainty in Classification Performance: ROC Confidence Bands Using Conformal Prediction

Zheshi Zheng, Bo Yang, Peter Song

To evaluate a classification algorithm, it is common practice to plot the ROC curve using test data. However, the inherent randomness in the test data can undermine our confidence…