Where are we now? A large benchmark study of recent symbolic regression methods
arXiv:1804.09331 · doi:10.1145/3205455.3205539
Abstract
In this paper we provide a broad benchmarking of recent genetic programming approaches to symbolic regression in the context of state of the art machine learning approaches. We use a set of nearly 100 regression benchmark problems culled from open source repositories across the web. We conduct a rigorous benchmarking of four recent symbolic regression approaches as well as nine machine learning approaches from scikit-learn. The results suggest that symbolic regression performs strongly compared to state-of-the-art gradient boosting algorithms, although in terms of running times is among the slowest of the available methodologies. We discuss the results in detail and point to future research directions that may allow symbolic regression to gain wider adoption in the machine learning community.
8 pages, 4 figures. GECCO 2018
References in corpus (16)
- Adam: A Method for Stochastic Optimization
- Scikit-learn: Machine Learning in Python
- XGBoost: A Scalable Tree Boosting System
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Rejoinder to "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Least Angle Regression
- Discussion of "Least angle regression" by Efron et al
- OpenML: networked science in machine learning
- Epsilon-Lexicase Selection for Regression
- Symbolic Regression Algorithms with Built-in Linear Regression
Cited by in corpus (20)
- Symbolic Regression in Materials Science
- Improving Model-based Genetic Programming for Symbolic Regression of Small Expressions
- A computational framework for physics-informed symbolic regression with straightforward integration of domain knowledge
- Shape-constrained Symbolic Regression -- Improving Extrapolation with Prior Knowledge
- Language Model Crossover: Variation through Few-Shot Prompting
- Automated Data-Driven Discovery of Material Models Based on Symbolic Regression: A Case Study on Human Brain Cortex
- Interpretability in Symbolic Regression: a benchmark of Explanatory Methods using the Feynman data set
- Symbolic Regression as Feature Engineering Method for Machine and Deep Learning Regression Tasks
- Semantic variation operators for multidimensional genetic programming
- Automated Learning of Interpretable Models with Quantified Uncertainty
- A Novel Neural Network-Based Symbolic Regression Method: Neuro-Encoded Expression Programming
- Symbolic-Regression Boosting
- Information Fusion via Symbolic Regression: A Tutorial in the Context of Human Health
- Call for Action: towards the next generation of symbolic regression benchmark
- Over-optimism in benchmark studies and the multiplicity of design and analysis options when interpreting their results
- Simple Genetic Operators are Universal Approximators of Probability Distributions (and other Advantages of Expressive Encodings)
- SPINEX_ Symbolic Regression: Similarity-based Symbolic Regression with Explainable Neighbors Exploration
- EBIC.JL -- an Efficient Implementation of Evolutionary Biclustering Algorithm in Julia
- Symbolic Regression with Fast Function Extraction and Nonlinear Least Squares Optimization
- Untangling the Effects of Down-Sampling and Selection in Genetic Programming