Sequential Probability Ratio Test using Z-Statistics (SPRT-z): A Practical Approach for Online Experimentation

Derek L. Ho, Emma G. Thomas

Modern online experimentation platforms produce data at scale and continuously. However, practitioners routinely apply Fixed Horizon Testing (FHT) under repeated peeking, inflating…