4 papers
On the Use of Causal Graphical Models for Designing Experiments in the Automotive Domain
David Issa Mattos, Yuchu Liu
Randomized field experiments are the gold standard for evaluating the impact of software changes on customers. In the online domain, randomization has been the main tool to ensure…
On the Assessment of Benchmark Suites for Algorithm Comparison
David Issa Mattos, Lucas Ruud, Jan Bosch +1
Benchmark suites, i.e. a collection of benchmark functions, are widely used in the comparison of black-box optimization algorithms. Over the years, research has identified many des…
Bayesian Paired-Comparison with the bpcs Package
David Issa Mattos, Érika Martins Silva Ramos
This article introduces the bpcs R package (Bayesian Paired Comparison in Stan) and the statistical models implemented in the package. This package aims to facilitate the use of Ba…
Engineering for a Science-Centric Experimentation Platform
Nikos Diamantopoulos, Jeffrey Wong, David Issa Mattos +4
Netflix is an internet entertainment service that routinely employs experimentation to guide strategy around product innovations. As Netflix grew, it had the opportunity to explore…