It's About Time: What A/B Test Metrics Estimate

Sebastian Ankargren, Mattias Frånberg, Mårten Schultzberg

Online controlled experiments, or A/B tests, are large-scale randomized trials in digital environments. This paper investigates the estimands of the difference-in-means estimator i…