Certainty-Validity: A Diagnostic Framework for Discrete Commitment Systems

Datorien L. Anderson

Standard evaluation metrics for machine learning -- accuracy, precision, recall, and AUROC -- assume that all errors are equivalent: a confident incorrect prediction is penalized i…