Can This LLM Annotate My Data? Estimating Zero-Shot LLM Performance

Tong Lin, Grant Schoenebeck, Sabina Tomkins

Large language models (LLMs) are increasingly used in annotation tasks with varying success. While several studies have demonstrated the opportunities and shortcomings of LLMs for…