Can Unconfident LLM Annotations Be Used for Confident Conclusions?

Kristina Gligorić, Tijana Zrnic, Cinoo Lee +2

Large language models (LLMs) have shown high agreement with human raters across a variety of tasks, demonstrating potential to ease the challenges of human data collection. In comp…