6 citations · 10 across the 5 of their papers we have counts for
12 papers
The equivalence of the Delta method and the cluster-robust variance estimator for the analysis of clustered randomized experiments
Alex Deng, Jiannan Lu, Wen Qin
It often happens that the same problem presents itself to different communities and the solutions proposed or adopted by those communities are different. We take the case of the va…
Novelty and Primacy: A Long-Term Estimator for Online Experiments
Soheil Sadeghi, Somit Gupta, Stefan Gramatovici +3
Online experiments are the gold standard for evaluating impact on user experience and accelerating innovation in software. However, since experiments are typically limited in durat…
Sharp bounds on the relative treatment effect for ordinal outcomes
Jiannan Lu, Yunshu Zhang, Peng Ding
For ordinal outcomes, the average treatment effect is often ill-defined and hard to interpret. Echoing Agresti and Kateri (2017), we argue that the relative treatment effect can be…
On Heavy-user Bias in A/B Testing
Yu Wang, Somit Gupta, Jiannan Lu +2
On-line experimentation (also known as A/B testing) has become an integral part of software development. To timely incorporate user feedback and continuously improve products, many…
Applying the Delta method in metric analytics: A practical guide with novel ideas
Alex Deng, Ulf Knoblich, Jiannan Lu
During the last decade, the information technology industry has adopted a data-driven culture, relying on online metrics to measure and monitor business performance. Under the sett…
Improved Neymanian analysis for factorial designs with binary outcomes
Jiannan Lu
factorial designs are widely adopted by statisticians and the broader scientific community. In this short note, under the potential outcomes framework (Neyman, 1923; Rubin, 1…