The Ghost Annotator: a Framework to Explore Human Label Variation in Content Moderation through Conformal Prediction

Mirko Lai, Alessandra Urbinati, Simona Frenda +2

Current research primarily focuses on model performance, while comparatively less attention has been devoted to uncertainty estimation, particularly in settings where LLMs are incr…