Observational Equivalence of LLM and Human Annotation

Kentaro Nakamura, Jing Ling Tan, George Yean

In this paper, we show that LLM and human coding are observationally equivalent in terms of annotation quality: recent LLMs agree with expert coders at rates comparable to those ob…