Evaluating Black-Box Classifiers via Stable Adaptive Two-Sample Inference

Yuchen Chen, Jing Lei

We consider the problem of evaluating black-box multi-class classifiers. In the standard setup, we observe class labels $Y\in \{0,1,\dots ,M-1\}$ generated according to the conditi…