2 papers
cs.IR2024
Powerful A/B-Testing Metrics and Where to Find Them
Olivier Jeunen, Shubham Baweja, Neeti Pokharna +1
Online controlled experiments, colloquially known as A/B-tests, are the bread and butter of real-world recommender system evaluation. Typically, end-users are randomly assigned som…
cs.LG2024
Variance Reduction in Ratio Metrics for Efficient Online Experiments
Shubham Baweja, Neeti Pokharna, Aleksei Ustimenko +1
Online controlled experiments, such as A/B-tests, are commonly used by modern tech companies to enable continuous system improvements. Despite their paramount importance, A/B-tests…