Trust, or Don't Predict: Introducing the CWSA Family for Confidence-Aware Model Evaluation

Kourosh Shahnazari, Seyed Moein Ayyoubzadeh, Mohammadali Keshtparvar +1

In recent machine learning systems, confidence scores are being utilized more and more to manage selective prediction, whereby a model can abstain from making a prediction when it…