Empirical Optimal Risk to Quantify Model Trustworthiness for Failure Detection

Shuang Ao, Stefan Rueger, Advaith Siddharthan

Failure detection (FD) in AI systems is a crucial safeguard for the deployment for safety-critical tasks. The common evaluation method of FD performance is the Risk-coverage (RC) c…