activity
20162025
most citedBenchmarking in Optimization: Best Practice and Open Issues

82 citations · 106 across the 10 of their papers we have counts for

collaborators
Showing cs.NEShow all

7 papers · 1 filter

cs.NE2025

Benchmarking that Matters: Rethinking Benchmarking for Practical Impact

Anna V. Kononova, Niki van Stein, Olaf Mersmann +14

Benchmarking has driven scientific progress in Evolutionary Computation, yet current practices fall short of real-world needs. Widely used synthetic suites such as BBOB and CEC iso…

cs.NE2021

Automating Speedrun Routing: Overview and Vision

Matthias Groß, Dietlind Zühlke, Boris Naujoks

Speedrunning in general means to play a video game fast, i.e. using all means at one's disposal to achieve a given goal in the least amount of time possible. To do so, a speedrun m…

cs.NE2020★ 7 cited

Identifying Properties of Real-World Optimisation Problems through a Questionnaire

Koen van der Blom, Timo M. Deist, Vanessa Volz +5

Optimisation algorithms are commonly compared on benchmarks to get insight into performance differences. However, it is not clear how closely benchmarks match the properties of rea…

cs.NE2020★ 82 cited

Benchmarking in Optimization: Best Practice and Open Issues

Thomas Bartz-Beielstein, Carola Doerr, Daan van den Berg +14

This survey compiles ideas and recommendations from more than a dozen researchers with different backgrounds and from different institutes around the world. Promoting best practice…

cs.NE2020★ 6 cited

Towards Realistic Optimization Benchmarks: A Questionnaire on the Properties of Real-World Problems

Koen van der Blom, Timo M. Deist, Tea Tušar +5

Benchmarks are a useful tool for empirical performance comparisons. However, one of the main shortcomings of existing benchmarks is that it remains largely unclear how they relate…

cs.NE2020★ 1 cited

Expected Improvement versus Predicted Value in Surrogate-Based Optimization

Frederik Rehbach, Martin Zaefferer, Boris Naujoks +1

Surrogate-based optimization relies on so-called infill criteria (acquisition functions) to decide which point to evaluate next. When Kriging is used as the surrogate model of choi…

cs.NE2016

Surrogate-Assisted Partial Order-based Evolutionary Optimisation

Vanessa Volz, Günter Rudolph, Boris Naujoks

In this paper, we propose a novel approach (SAPEO) to support the survival selection process in multi-objective evolutionary algorithms with surrogate models - it dynamically choos…