A Bayesian machine scientist to aid in the solution of challenging scientific problems

Abstract

Closed-form, interpretable mathematical models have been instrumental for advancing our understanding of the world; with the data revolution, we may now be in a position to uncover new such models for many systems from physics to the social sciences. However, to deal with increasing amounts of data, we need "machine scientists" that are able to extract these models automatically from data. Here, we introduce a Bayesian machine scientist, which establishes the plausibility of models using explicit approximations to the exact marginal posterior over models and establishes its prior expectations about models by learning from a large empirical corpus of mathematical expressions. It explores the space of models using Markov chain Monte Carlo. We show that this approach uncovers accurate models for synthetic and real data and provides out-of-sample predictions that are more accurate than those of existing approaches and of other nonparametric methods.

References in corpus (1)

• The ALAMO approach to machine learning

Cited by in corpus (22)

• Deep symbolic regression for physics guided by units constraints: toward the automated discovery of physical laws
• Using generative AI to investigate medical imagery models and datasets
• SINDy for delay-differential equations: application to model bacterial zinc response
• Human mobility is well described by closed-form gravity-like models learned automatically from data
• Fundamental limits to learning closed-form mathematical models from data
• Catch-22s of reservoir computing
• Efficient Generator of Mathematical Expressions for Symbolic Regression
• Evolving Scientific Discovery by Unifying Data and Background Knowledge with AI Hilbert
• Priors for symbolic regression
• Is the Machine Smarter than the Theorist: Deriving Formulas for Particle Kinematics with Symbolic Regression
• Optimal Inflationary Potentials
• Bayesian machine scientist to compare data collapses for the Nikuradse dataset
• The Inefficiency of Genetic Programming for Symbolic Regression
• Using machine learning to find exact analytic solutions to analytically posed physics problems
• Discovering Symmetries of ODEs by Symbolic Regression
• From reductionism to realism: Holistic mathematical modelling for complex biological systems
• Dimension Reduction for Symbolic Regression
• KAN-SR: A Kolmogorov-Arnold Network Guided Symbolic Regression Framework
• The hidden architecture of connections: How do multidimensional identities shape our social networks?
• Statistical Patterns in the Equations of Physics and the Emergence of a Meta-Law of Nature
• LMFD: Latent Monotonic Feature Discovery
• The Limits of Inference in Complex Systems: When Stochastic Models Become Indistinguishable