Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
Variance Reduction for Heavy-Tailed Monetization Metrics in Ranking Experiments via Post-Stratification
Neeti Pokharna, Olivier Jeunen, Yatharth Saraf +1
Online evaluation of ranking and retrieval systems often relies on downstream monetization metrics such as app revenue or creator earnings. These metrics are typically heavy-tailed…
cs.LG2024
: Off-Policy Estimation with Pairs of Policies
Olivier Jeunen, Aleksei Ustimenko
The off-policy paradigm casts recommendation as a counterfactual decision-making task, allowing practitioners to unbiasedly estimate online metrics using offline data. This leads t…
cs.LG2024
Learning Metrics that Maximise Power for Accelerated A/B-Tests
Olivier Jeunen, Aleksei Ustimenko
Online controlled experiments are a crucial tool to allow for confident decision-making in technology companies. A North Star metric is defined (such as long-term revenue or user r…