Exhaustive Symbolic Regression

Abstract

Symbolic Regression (SR) algorithms attempt to learn analytic expressions which fit data accurately and in a highly interpretable manner. Conventional SR suffers from two fundamental issues which we address here. First, these methods search the space stochastically (typically using genetic programming) and hence do not necessarily find the best function. Second, the criteria used to select the equation optimally balancing accuracy with simplicity have been variable and subjective. To address these issues we introduce Exhaustive Symbolic Regression (ESR), which systematically and efficiently considers all possible equations -- made with a given basis set of operators and up to a specified maximum complexity -- and is therefore guaranteed to find the true optimum (if parameters are perfectly optimised) and a complete function ranking subject to these constraints. We implement the minimum description length principle as a rigorous method for combining these preferences into a single objective. To illustrate the power of ESR we apply it to a catalogue of cosmic chronometers and the Pantheon+ sample of supernovae to learn the Hubble rate as a function of redshift, finding $\sim$40 functions (out of 5.2 million trial functions) that fit the data more economically than the Friedmann equation. These low-redshift data therefore do not uniquely prefer the expansion history of the standard model of cosmology. We make our code and full equation sets publicly available.

arXiv comment15 pages, 7 figures, 2 tables. Accepted for publication in the IEEE Transactions on Evolutionary Computation

References in corpus (30)

• SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
• Array Programming with NumPy
• Observational Evidence from Supernovae for an Accelerating Universe and a Cosmological Constant
• Measurements of Omega and Lambda from 42 High-Redshift Supernovae
• A Universal Density Profile from Hierarchical Clustering
• The Astropy Project: Building an inclusive, open-science project and status of the v2.0 core package
• A Comprehensive Measurement of the Local Value of the Hubble Constant with 1 km/s/Mpc Uncertainty from the Hubble Space Telescope and the SH0ES Team
• The Pantheon+ Analysis: Cosmological Constraints
• Constraints on the redshift dependence of the dark energy potential
• A 6% measurement of the Hubble parameter at $z\sim 0.45$: direct evidence of the epoch of cosmic re-acceleration
• Cosmic Chronometers: Constraining the Equation of State of Dark Energy. I: H(z) Measurements
• Raising the bar: new constraints on the Hubble parameter with cosmic chronometers at z$\sim$2
• Improved constraints on the expansion rate of the Universe up to z~1.1 from the spectroscopic evolution of cosmic chronometers
• Constraining Cosmological Parameters Based on Relative Galaxy Ages
• Age-dating Luminous Red Galaxies observed with the Southern African Large Telescope
• Setting the Stage for Cosmic Chronometers. II. Impact of Stellar Population Synthesis Models Systematics and Full Covariance Matrix
• Toward a Better Understanding of Cosmic Chronometers: A new measurement of H(z) at z~0.7
• Contemporary Symbolic Regression Methods and their Relative Performance
• Curvature vs Distances: testing the FLRW cosmology
• A new perspective on Dark Energy modeling via Genetic Algorithms
• A model independent null test on the cosmological constant
• What can Machine Learning tell us about the background expansion of the Universe?
• Genetic Algorithms and Supernovae Type Ia Analysis
• Minimum Description Length Revisited
• Hints of dark energy anisotropic stress using Machine Learning
• An Approach to Symbolic Regression Using Feyn
• Machine learning constraints on deviations from general relativity from the large scale structure of the Universe
• Machine Learning meets the redshift evolution of the CMB Temperature
• On the functional form of the radial acceleration relation
• Complexity Measures for Multi-objective Symbolic Regression

Cited by in corpus (13)

• syren-halofit: A fast, interpretable, high-precision formula for the $\Lambda$CDM nonlinear matter power spectrum
• A precise symbolic emulator of the linear matter power spectrum
• syren-new: Precise formulae for the linear and nonlinear matter power spectra with massive neutrinos and dynamical dark energy
• Optimal Inflationary Potentials
• Machine learning unveils the linear matter power spectrum of modified gravity
• The Inefficiency of Genetic Programming for Symbolic Regression
• cp3-bench: A tool for benchmarking symbolic regression algorithms tested with cosmology
• Improving Genetic Programming for Symbolic Regression with Equality Graphs
• Call for Action: towards the next generation of symbolic regression benchmark
• Machine Learning-Based Analytical Expressions for Gray-Body Factors and Application to Primordial Black Holes
• Constraining dark matter halo profiles with symbolic regression
• Statistical Patterns in the Equations of Physics and the Emergence of a Meta-Law of Nature
• Spatially resolved stellar-to-total dynamical mass relation: Radial variations, gradients and profiles of galaxy stellar populations