Epsilon-Lexicase Selection for Regression

Abstract

Lexicase selection is a parent selection method that considers test cases separately, rather than in aggregate, when performing parent selection. It performs well in discrete error spaces but not on the continuous-valued problems that compose most system identification tasks. In this paper, we develop a new form of lexicase selection for symbolic regression, named epsilon-lexicase selection, that redefines the pass condition for individuals on each test case in a more effective way. We run a series of experiments on real-world and synthetic problems with several treatments of epsilon and quantify how epsilon affects parent selection and model performance. epsilon-lexicase selection is shown to be effective for regression, producing better fit models compared to other techniques such as tournament selection and age-fitness Pareto optimization. We demonstrate that epsilon can be adapted automatically for individual test cases based on the population performance distribution. Our experiments show that epsilon-lexicase selection with automatic epsilon produces the most accurate models across tested problems with negligible computational overhead. We show that behavioral diversity is exceptionally high in lexicase selection treatments, and that epsilon-lexicase selection makes use of more fitness cases when selecting parents than lexicase selection, which helps explain the performance improvement.

9 pages, 9 figures. Presented at GECCO '16. Includes correction

Cited by in corpus (18)

• Where are we now? A large benchmark study of recent symbolic regression methods
• Lexicase selection in Learning Classifier Systems
• Lexicase Selection of Specialists
• Analytic Continued Fractions for Regression: A Memetic Algorithm Approach
• Genetic programming approaches to learning fair classifiers
• Semantic variation operators for multidimensional genetic programming
• Lexicase Selection at Scale
• Comparing and Combining Lexicase Selection and Novelty Search
• Probabilistic Lexicase Selection
• Analysing Symbolic Regression Benchmarks under a Meta-Learning Approach
• Information Fusion via Symbolic Regression: A Tutorial in the Context of Human Health
• Calculating lexicase selection probabilities is NP-Hard
• EBIC.JL -- an Efficient Implementation of Evolutionary Biclustering Algorithm in Julia
• rEGGression: an Interactive and Agnostic Tool for the Exploration of Symbolic Regression Models
• Discovering Symmetries of ODEs by Symbolic Regression
• Minimum variance threshold for epsilon-lexicase selection
• Reachability Analysis for Lexicase Selection via Community Assembly Graphs
• Towards symbolic regression for interpretable clinical decision scores