3 papers
cs.IR2024
Powerful A/B-Testing Metrics and Where to Find Them
Olivier Jeunen, Shubham Baweja, Neeti Pokharna +1
Online controlled experiments, colloquially known as A/B-tests, are the bread and butter of real-world recommender system evaluation. Typically, end-users are randomly assigned som…
cs.LG2024
Variance Reduction in Ratio Metrics for Efficient Online Experiments
Shubham Baweja, Neeti Pokharna, Aleksei Ustimenko +1
Online controlled experiments, such as A/B-tests, are commonly used by modern tech companies to enable continuous system improvements. Despite their paramount importance, A/B-tests…
cs.IR2024
Learning-to-Rank with Nested Feedback
Hitesh Sagtani, Olivier Jeunen, Aleksei Ustimenko
Many platforms on the web present ranked lists of content to users, typically optimized for engagement-, satisfaction- or retention- driven metrics. Advances in the Learning-to-Ran…