On Post-Selection Inference in A/B Tests

Alex Deng, Yicheng Li, Jiannan Lu +1

When interpreting A/B tests, we typically focus only on the statistically significant results and take them by face value. This practice, termed post-selection inference in the sta…