Exploiting Similarities in A/B Testing with Off-Policy Estimation

Otmane Sakhi, Alexandre Gilotte, David Rohde

We study A/B testing, the standard protocol for measuring the performance gain of a new decision system relative to a baseline. Traditional A/B testing treats both systems as black…