Showing stat.MEShow all
3 papers · 1 filter
stat.ME2026
Testing for trends in online experiments
Chris Haulk, Lee Richardson, Jacopo Soriano
Time-varying treatment effects can be estimated with linear regression paired with jackknife confidence intervals. In experiments at a large online video platform, the test based o…
stat.ME2023
Choosing a Proxy Metric from Past Experiments
Nilesh Tripuraneni, Lee Richardson, Alexander D'Amour +2
In many randomized experiments, the treatment effect of the long-term metric (i.e. the primary outcome of interest) is often difficult or infeasible to measure. Such long-term metr…
stat.ME2023
Pareto optimal proxy metrics
Alessandro Zito, Dylan Greaves, Jacopo Soriano +1
North star metrics and online experimentation play a central role in how technology companies improve their products. In many practical settings, however, evaluating experiments ba…