Dealing With Ratio Metrics in A/B Testing at the Presence of Intra-User Correlation and Segments

Keyu Nie, Yinfei Kong, Ted Tao Yuan +1

We study ratio metrics in A/B testing at the presence of correlation among observations coming from the same user and provides practical guidance especially when two metrics contra…