Variance Reduction for Heavy-Tailed Monetization Metrics in Ranking Experiments via Post-Stratification

Neeti Pokharna, Olivier Jeunen, Yatharth Saraf +1

Online evaluation of ranking and retrieval systems often relies on downstream monetization metrics such as app revenue or creator earnings. These metrics are typically heavy-tailed…