Neural-Guided Symbolic Regression with Asymptotic Constraints

Abstract

Symbolic regression is a type of discrete optimization problem that involves searching expressions that fit given data points. In many cases, other mathematical constraints about the unknown expression not only provide more information beyond just values at some inputs, but also effectively constrain the search space. We identify the asymptotic constraints of leading polynomial powers as the function approaches zero and infinity as useful constraints and create a system to use them for symbolic regression. The first part of the system is a conditional production rule generating neural network which preferentially generates production rules to construct expressions with the desired leading powers, producing novel expressions outside the training domain. The second part, which we call Neural-Guided Monte Carlo Tree Search, uses the network during a search to find an expression that conforms to a set of data points and desired leading powers. Lastly, we provide an extensive experimental validation on thousands of target expressions showing the efficacy of our system compared to exiting methods for finding unknown functions outside of the training set.

References in corpus (10)

• Learning to Plan Chemical Syntheses
• Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks
• Searching for Activation Functions
• DeepCoder: Learning to Write Programs
• Prediction of Dynamical Systems by Symbolic Regression
• Grammar Variational Autoencoder
• RobustFill: Neural Program Learning under Noisy I/O
• Neuro-Symbolic Program Synthesis
• Neural-Guided Deductive Search for Real-Time Program Synthesis from Examples
• Learning Equations for Extrapolation and Control

Cited by in corpus (8)

• Explainable Machine Learning for Scientific Insights and Discoveries
• Discovering Symbolic Models from Deep Learning with Inductive Biases
• Shape-constrained Symbolic Regression -- Improving Extrapolation with Prior Knowledge
• Tensor network approaches for learning non-linear dynamical laws
• Information Fusion via Symbolic Regression: A Tutorial in the Context of Human Health
• Informed Equation Learning
• Visual Physics: Discovering Physical Laws from Videos
• Incorporating domain knowledge into neural-guided search