SymbolFit: Automatic Parametric Modeling with Symbolic Regression

Abstract

We introduce SymbolFit, a framework that automates parametric modeling by using symbolic regression to perform a machine-search for functions that fit the data while simultaneously providing uncertainty estimates in a single run. Traditionally, constructing a parametric model to accurately describe binned data has been a manual and iterative process, requiring an adequate functional form to be determined before the fit can be performed. The main challenge arises when the appropriate functional forms cannot be derived from first principles, especially when there is no underlying true closed-form function for the distribution. In this work, we develop a framework that automates and streamlines the process by utilizing symbolic regression, a machine learning technique that explores a vast space of candidate functions without requiring a predefined functional form because the functional form itself is treated as a trainable parameter, making the process far more efficient and effortless than traditional regression methods. We demonstrate the framework in high-energy physics experiments at the CERN Large Hadron Collider (LHC) using five real proton-proton collision datasets from new physics searches, including background modeling in resonance searches for high-mass dijet, trijet, paired-dijet, diphoton, and dimuon events. We show that our framework can flexibly and efficiently generate a wide range of candidate functions that fit a nontrivial distribution well using a simple fit configuration that varies only by random seed, and that the same fit configuration, which defines a vast function space, can also be applied to distributions of different shapes, whereas achieving a comparable result with traditional methods would have required extensive manual effort.

52 pages, 35 figures. Under review. The API can be used out-of-the-box and is available at https://github.com/hftsoi/symbolfit

References in corpus (19)

• Observation of a new particle in the search for the Standard Model Higgs boson with the ATLAS detector at the LHC
• Observation of a new boson at a mass of 125 GeV with the CMS experiment at the LHC
• Jet energy scale and resolution in the CMS experiment in pp collisions at 8 TeV
• Identification of heavy-flavour jets with the CMS detector in pp collisions at 13 TeV
• Performance of reconstruction and identification of $\tau$ leptons decaying to hadrons and ${\nu }_{\tau }$ in pp collisions at $\sqrt{s}=$ 13 TeV
• A Survey of Constrained Gaussian Process Regression: Approaches and Implementation Challenges
• Contemporary Symbolic Regression Methods and their Relative Performance
• Improving Model-based Genetic Programming for Symbolic Regression of Small Expressions
• A computational framework for physics-informed symbolic regression with straightforward integration of domain knowledge
• Handling uncertainties in background shapes: the discrete profiling method
• Inclusive search for highly boosted Higgs bosons decaying to bottom quark-antiquark pairs in proton-proton collisions at $\sqrt{s}=$ 13 TeV
• Finding universal relations in subhalo properties with artificial intelligence
• The SZ flux-mass ($Y$-$M$) relation at low halo masses: improvements with symbolic regression and strong constraints on baryonic feedback
• Back to the Formula -- LHC Edition
• Symbolic Regression on FPGAs for Fast Machine Learning Inference
• Interpretable Machine Learning Methods Applied to Jet Background Subtraction in Heavy Ion Collisions
• Discovery of a Planar Black Hole Mass Scaling Relation for Spiral Galaxies
• SymbolNet: Neural Symbolic Regression with Adaptive Dynamic Pruning for Compression
• Search for narrow trijet resonances in proton-proton collisions at $\sqrt{s}$ = 13 TeV

Cited by in corpus (3)

• Gaussian Process Regression as a Sustainable Data-driven Background Estimate Method at the (HL)-LHC
• Enhancing di-jet resonance searches via a final-state radiation jet tagging algorithm
• The Physics Behind ML-based Quark-Gluon Taggers