Fast yet Safe: Early-Exiting with Risk Control

Metod Jazbec, Alexander Timans, Tin Hadži Veljković +4

Scaling machine learning models significantly improves their performance. However, such gains come at the cost of inference being slow and resource-intensive. Early-exit neural net…