Statistical Models for the Analysis of Optimization Algorithms with Benchmark Functions

David Issa Mattos, Jan Bosch, Helena Holmström Olsson

Frequentist statistical methods, such as hypothesis testing, are standard practice in papers that provide benchmark comparisons. Unfortunately, these methods have often been misuse…