131 citations · 177 across the 7 of their papers we have counts for
7 papers
Enterprise Experimentation with Hierarchical Entities
Shan Ba, Shilpa Garg, Jitendra Agarwal +1
In this paper, we address the challenges in running enterprise experimentation with hierarchical entities and present the methodologies behind the implementation of the Enterprise…
Producer-Side Experiments Based on Counterfactual Interleaving Designs for Online Recommender Systems
Yan Wang, Shan Ba
Recommender systems have become an integral part of online platforms, providing personalized recommendations for purchases, content consumption, and interpersonal connections. Thes…
Towards Optimal Variance Reduction in Online Controlled Experiments
Ying Jin, Shan Ba
We study optimal variance reduction solutions for count and ratio metrics in online controlled experiments. Our methods leverage flexible machine learning tools to incorporate cova…
Online Experimentation with Surrogate Metrics: Guidelines and a Case Study
Weitao Duan, Shan Ba, Chunzhe Zhang
A/B tests have been widely adopted across industries as the golden rule that guides decision making. However, the long-term true north metrics we ultimately want to drive through A…
Robust Experimental Designs for Model Calibration
Arvind Krishna, V. Roshan Joseph, Shan Ba +2
A computer model can be used for predicting an output only after specifying the values of some unknown physical constants known as calibration parameters. The unknown calibration p…
Space-Filling Designs for Robustness Experiments
V. Roshan Joseph, Li Gu, Shan Ba +1
To identify the robust settings of the control factors, it is very important to understand how they interact with the noise factors. In this article, we propose space-filling desig…