1 citations · 2 across the 7 of their papers we have counts for
7 papers
Evaluating for the long term: Learnings from industry
Leif Sigerson, Tom Cunningham, Winston Chou +22
Online platforms prioritize long-term business outcomes, yet typical experiments are far too short to measure these outcomes directly. Our goal in this paper is to collect and shar…
Evaluating Decision Rules Across Many Weak Experiments
Winston Chou, Colin Gray, Nathan Kallus +2
Technology firms conduct randomized controlled experiments ("A/B tests") to learn which actions to take to improve business outcomes. In firms with mature experimentation platforms…
Optimizing Returns from Experimentation Programs
Timothy Sudijono, Simon Ejdemyr, Apoorva Lal +1
Experimentation in online digital platforms is used to inform decision making. Specifically, the goal of many experiments is to optimize a metric of interest. Null hypothesis stati…
Learning the Covariance of Treatment Effects Across Many Weak Experiments
Aurélien Bibaut, Winston Chou, Simon Ejdemyr +1
When primary objectives are insensitive or delayed, experimenters may instead focus on proxy metrics derived from secondary outcomes. For example, technology companies often infer…
Long-Term Causal Inference with Imperfect Surrogates using Many Weak Experiments, Proxies, and Cross-Fold Moments
Aurélien Bibaut, Nathan Kallus, Simon Ejdemyr +1
Inferring causal effects on long-term outcomes using short-term surrogates is crucial to rapid innovation. However, even when treatments are randomized and surrogates fully mediate…
A Framework for Generalization and Transportation of Causal Estimates Under Covariate Shift
Apoorva Lal, Wenjing Zheng, Simon Ejdemyr
Randomized experiments are an excellent tool for estimating internally valid causal effects with the sample at hand, but their external validity is frequently debated. While classi…
Success Stories from a Democratized Experimentation Platform
Eskil Forsell, Julie Beckley, Simon Ejdemyr +5
We demonstrate the effectiveness of democratization and efficient computation as key concepts of our experimentation platform (XP) by presenting four new models supported by the pl…