A Prescription of Methodological Guidelines for Comparing Bio-inspired Optimization Algorithms
arXiv:2004.09969 · doi:10.1016/j.swevo.2021.100973
Abstract
Bio-inspired optimization (including Evolutionary Computation and Swarm Intelligence) is a growing research topic with many competitive bio-inspired algorithms being proposed every year. In such an active area, preparing a successful proposal of a new bio-inspired algorithm is not an easy task. Given the maturity of this research field, proposing a new optimization technique with innovative elements is no longer enough. Apart from the novelty, results reported by the authors should be proven to achieve a significant advance over previous outcomes from the state of the art. Unfortunately, not all new proposals deal with this requirement properly. Some of them fail to select appropriate benchmarks or reference algorithms to compare with. In other cases, the validation process carried out is not defined in a principled way (or is even not done at all). Consequently, the significance of the results presented in such studies cannot be guaranteed. In this work we review several recommendations in the literature and propose methodological guidelines to prepare a successful proposal, taking all these issues into account. We expect these guidelines to be useful not only for authors, but also for reviewers and editors along their assessment of new contributions to the field.
81 pages, 4 figures
References in corpus (9)
- ParamILS: An Automatic Algorithm Configuration Framework
- Recent Trends in the Use of Statistical Tests for Comparing Swarm and Evolutionary Computing Algorithms: Practical Guidelines and a Critical Review
- A Tutorial on the Design, Experimentation and Application of Metaheuristic Algorithms to Real-World Optimization Problems
- Comprehensive Taxonomies of Nature- and Bio-inspired Optimization: Inspiration versus Algorithmic Behavior, Critical Analysis and Recommendations (from 2020 to 2024)
- Infeasibility and structural bias in Differential Evolution
- Structural bias in population-based algorithms
- Mitigating Metaphors: A Comprehensible Guide to Recent Nature-Inspired Algorithms
- Benchmarking Evolutionary Algorithms For Single Objective Real-valued Constrained Optimization - A Critical Review
- Genetic and Memetic Algorithm with Diversity Equilibrium based on Greedy Diversification