Just Put a Human in the Loop? Investigating LLM-Assisted Annotation for Subjective Tasks

Hope Schroeder, Deb Roy, Jad Kabbara

LLM use in annotation is becoming widespread, and given LLMs' overall promising performance and speed, simply "reviewing" LLM annotations in interpretive tasks can be tempting. In…