Observational Equivalence of LLM and Human Annotation

Kentaro Nakamura, Jing Ling Tan, George Yean

In this paper, we show that humans and large language models (LLMs) are observationally equivalent in coding texts. Recent LLMs agree with attentive humans at rates comparable to t…