activity
20192022
most citedBayesian Paired-Comparison with the bpcs Package

4 citations · 14 across the 6 of their papers we have counts for

collaborators

8 papers

cs.SE2022★ 3 cited

Bayesian causal inference in automotive software engineering and online evaluation

Yuchu Liu, David Issa Mattos, Jan Bosch +2

Randomised field experiments, such as A/B testing, have long been the gold standard for evaluating software changes. In the automotive domain, running randomised field experiments…

cs.SE2022

On the Use of Causal Graphical Models for Designing Experiments in the Automotive Domain

David Issa Mattos, Yuchu Liu

Randomized field experiments are the gold standard for evaluating the impact of software changes on customers. In the online domain, randomization has been the main tool to ensure…

cs.SE2021★ 4 cited

Bayesian propensity score matching in automotive embedded software engineering

Yuchu Liu, David Issa Mattos, Jan Bosch +2

Randomised field experiments, such as A/B testing, have long been the gold standard for evaluating the value that new software brings to customers. However, running randomised fiel…

cs.SE2021★ 3 cited

Size matters? Or not: A/B testing with limited sample in automotive embedded software

Yuchu Liu, David Issa Mattos, Jan Bosch +2

A/B testing is gaining attention in the automotive sector as a promising tool to measure causal effects from software changes. Different from the web-facing businesses, where A/B t…

cs.NE2021

On the Assessment of Benchmark Suites for Algorithm Comparison

David Issa Mattos, Lucas Ruud, Jan Bosch +1

Benchmark suites, i.e. a collection of benchmark functions, are widely used in the comparison of black-box optimization algorithms. Over the years, research has identified many des…

stat.ME2021★ 4 cited

Bayesian Paired-Comparison with the bpcs Package

David Issa Mattos, Érika Martins Silva Ramos

This article introduces the bpcs R package (Bayesian Paired Comparison in Stan) and the statistical models implemented in the package. This package aims to facilitate the use of Ba…

stat.ME2020

Statistical Models for the Analysis of Optimization Algorithms with Benchmark Functions

David Issa Mattos, Jan Bosch, Helena Holmström Olsson

Frequentist statistical methods, such as hypothesis testing, are standard practice in papers that provide benchmark comparisons. Unfortunately, these methods have often been misuse…

cs.SE2019

Engineering for a Science-Centric Experimentation Platform

Nikos Diamantopoulos, Jeffrey Wong, David Issa Mattos +4

Netflix is an internet entertainment service that routinely employs experimentation to guide strategy around product innovations. As Netflix grew, it had the opportunity to explore…