Statistical Foundations of LLM-based A/B Testing: A Surrogacy Framework for Human Causal Inference

Joel Persson, Mårten Schultzberg, Sebastian Ankargren

Organizations and researchers show increasing interest in using large language models (LLMs) in place of human participants in A/B tests, in the hope of experimenting faster and at…