Efficient Evaluation-Time Uncertainty Estimation by Improved Distillation

Erik Englesson, Hossein Azizpour

In this work we aim to obtain computationally-efficient uncertainty estimates with deep networks. For this, we propose a modified knowledge distillation procedure that achieves sta…