Interpreting Predictive Probabilities: Model Confidence or Human Label Variation?

Joris Baan, Raquel Fernández, Barbara Plank +1

With the rise of increasingly powerful and user-facing NLP systems, there is growing interest in assessing whether they have a good representation of uncertainty by evaluating the…