A comparison of optimisation algorithms for high-dimensional particle and astrophysics applications

Abstract

Optimisation problems are ubiquitous in particle and astrophysics, and involve locating the optimum of a complicated function of many parameters that may be computationally expensive to evaluate. We describe a number of global optimisation algorithms that are not yet widely used in particle astrophysics, benchmark them against random sampling and existing techniques, and perform a detailed comparison of their performance on a range of test functions. These include four analytic test functions of varying dimensionality, and a realistic example derived from a recent global fit of weak-scale supersymmetry. Although the best algorithm to use depends on the function being investigated, we are able to present general conclusions about the relative merits of random sampling, Differential Evolution, Particle Swarm Optimisation, the Covariance Matrix Adaptation Evolution Strategy, Bayesian Optimisation, Grey Wolf Optimisation, and the PyGMO Artificial Bee Colony, Gaussian Particle Filter and Adaptive Memory Programming for Global Optimisation algorithms.

arXiv commentExperimental framework publicly available at http://www.github.com/darkmachines/high-dimensional-sampling

References in corpus (104)

• Adam: A Method for Stochastic Optimization
• Practical Bayesian Optimization of Machine Learning Algorithms
• Asymptotic formulae for likelihood-based tests of new physics
• MultiNest: an efficient and robust Bayesian inference tool for cosmology and particle physics
• Multimodal nested sampling: an efficient and robust alternative to MCMC methods for astronomical data analysis
• Importance Nested Sampling and the MultiNest Algorithm
• Self-Normalizing Neural Networks
• Data analysis recipes: Using Markov Chain Monte Carlo
• Fast and reliable MCMC for cosmological parameter estimation
• A Markov Chain Monte Carlo Analysis of the CMSSM
• The impact of priors and observables on parameter inferences in the Constrained MSSM
• An Updated Analysis of Inert Higgs Doublet Model in light of the Recent Results from LUX, PLANCK, AMS-02 and LHC
• The CMSSM and NUHM1 in Light of 7 TeV LHC, B_s to mu+mu- and XENON100 Data
• Scalable Global Optimization via Local Bayesian Optimization
• Global analyses of Higgs portal singlet dark matter models using GAMBIT
• Multi-Dimensional mSUGRA Likelihood Maps
• Fitting the Phenomenological MSSM
• Markov Chain Monte Carlo Exploration of Minimal Supergravity with Implications for Dark Matter
• Higgs and Supersymmetry
• Likelihood Analysis of the pMSSM11 in Light of LHC 13-TeV Data
• Indirect Dark Matter Detection from Dwarf Satellites: Joint Expectations from Astrophysics and Supersymmetry
• Likelihood Functions for Supersymmetric Observables in Frequentist Analyses of the CMSSM and NUHM1
• Global fits of GUT-scale SUSY models with GAMBIT
• $\text{HEPfit}$: a Code for the Combination of Indirect and Direct Constraints on High Energy Physics Models
• Implications for the Constrained MSSM from a new prediction for b to s gamma
• A global fit of the MSSM with GAMBIT
• Global Fits of the cMSSM and NUHM including the LHC Higgs discovery and new XENON100 constraints
• Fittino, a program for determining MSSM parameters from collider observables using an iterative method
• Natural Priors, CMSSM Fits and LHC Weather Forecasts
• The CMSSM and NUHM1 after LHC Run 1
• Constrained Supersymmetry after two years of LHC data: a global view with Fittino
• Implications of the Higgs Boson Discovery for mSUGRA
• Combined collider constraints on neutralinos and charginos
• Killing the cMSSM softly
• ColliderBit: a GAMBIT module for the calculation of high-energy collider observables and likelihoods
• Global fits of the two-loop renormalized Two-Higgs-Doublet model with soft $Z_2$ breaking
• GUT-inspired SUSY and the muon g-2 anomaly: prospects for LHC 14 TeV
• Updated global fits of the cMSSM including the latest LHC SUSY and Higgs searches and XENON100 data
• Effective Theory of WIMP Dark Matter supplemented by Simplified Models: Singlet-like Majorana fermion case
• A Profile Likelihood Analysis of the Constrained MSSM with Genetic Algorithms
• The Constrained NMSSM with a 126 GeV Higgs boson: A global analysis
• Direct Constraints on Minimal Supersymmetry from Fermi-LAT Observations of the Dwarf Galaxy Segue 1
• What next for the CMSSM and the NUHM: Improved prospects for superpartner and dark matter detection
• Dark matter and collider signatures of the MSSM
• Implications of Improved Higgs Mass Calculations for Supersymmetric Models
• Global Study of the Simplest Scalar Phantom Dark Matter Model
• Gluino-driven Radiative Breaking, Higgs Boson Mass, Muon $\mathbf{g}-2$, and the Higgs Diphoton Decay in SUGRA Unification
• Challenges of Profile Likelihood Evaluation in Multi-Dimensional SUSY Scans
• Supersymmetry and Dark Matter in Light of LHC 2010 and Xenon100 Data
• Predictions for Supersymmetric Particle Masses in the CMSSM using Indirect Experimental and Cosmological Constraints
• The pMSSM10 after LHC Run 1
• WIMP Dark Matter in a Well-Tempered Regime: A case study on Singlet-Doublets Fermionic WIMP
• Global fits of the cMSSM including the first LHC and XENON100 data
• Next-to-leading order unitarity fits in Two-Higgs-Doublet models with soft ${\mathbb{Z}}_2$ breaking
• The End of the CMSSM Coannihilation Strip is Nigh
• Global analysis of the pMSSM in light of the Fermi GeV excess: prospects for the LHC Run-II and astroparticle experiments
• Comparison of statistical sampling methods with ScannerBit, the GAMBIT scanning module
• Supersymmetry in Light of 1/fb of LHC Data
• Les Houches 2013: Physics at TeV Colliders: New Physics Working Group Report
• Identification of Dark Matter particles with LHC and direct detection data
• Impact of CMS Multi-jets and Missing Energy Search on CMSSM Fits
• Implications of Initial LHC Searches for Supersymmetry
• Frequentist Analysis of the Parameter Space of Minimal Supergravity
• Singlet Majorana fermion dark matter: a comprehensive analysis in effective field theory
• Profile likelihood maps of a 15-dimensional MSSM
• SFITTER: SUSY Parameter Analysis at LHC and LC
• Status of CMSSM in light of current LHC Run-2 and LUX data
• Constraining Supersymmetry using the relic density and the Higgs boson
• Bayesian Implications of Current LHC Supersymmetry and Dark Matter Detection Searches for the Constrained MSSM
• Global fits in the Georgi-Machacek model
• Global fits of the Non-Universal Higgs Model
• Should we still believe in constrained supersymmetry?
• Constraining SUSY models with Fittino using measurements before, with and beyond the LHC
• Light Fermionic WIMP Dark Matter with Light Scalar Mediator
• Selecting a Model of Supersymmetry Breaking Mediation
• Use of event-level neutrino telescope data in global fits for theories of new physics
• Prospects for direct dark matter detection in the Constrained MSSM
• Discovery potential for SUSY at a high luminosity upgrade of LHC14
• How well will ton-scale dark matter direct detection experiments constrain minimal supersymmetry?
• A global fit of the $\gamma$-ray galactic center excess within the scalar singlet Higgs portal model
• Bayesian Implications of Current LHC and XENON100 Search Limits for the Constrained MSSM
• The health of SUSY after the Higgs discovery and the XENON100 data
• On prospects for dark matter indirect detection in the Constrained MSSM
• Efficient reconstruction of CMSSM parameters from LHC data - A case study
• A Coverage Study of the CMSSM Based on ATLAS Sensitivity Using Fast Neural Networks Techniques
• The impact of the ATLAS zero-lepton, jets and missing momentum search on a CMSSM fit
• Effective Field Theory of Dark Matter: a Global Analysis
• Likelihood Analysis of the Minimal AMSB Model
• Bayesian naturalness of the CMSSM and CNMSSM
• LikeDM: likelihood calculator of dark matter detection
• Indirect and direct detection prospect for TeV dark matter in the MSSM-9
• Global fits of the Minimal Universal Extra Dimensions scenario
• Prospects for constrained supersymmetry at $\sqrt{s}=33$ TeV and $\sqrt{s}=100$ TeV proton-proton super-colliders
• Complementarity of Indirect and Accelerator Dark Matter Searches
• Constrained Supersymmetry after the Higgs Boson Discovery: A global analysis with Fittino
• The current status of fine-tuning in supersymmetry
• Phenomenological MSSM in light of new 13 TeV LHC data
• Statistical coverage for supersymmetric parameter estimation: a case study with direct detection of dark matter
• Fast supersymmetry phenomenology at the Large Hadron Collider using machine learning techniques
• Naturalness of MSSM dark matter
• Likelihood Analysis of Supersymmetric SU(5) GUTs
• Determination of the CMSSM Parameters using Neural Networks
• Dark Matter Searches: The Nightmare Scenario
• Where to look for natural supersymmetry

Cited by in corpus (12)

• The CosmoVerse White Paper: Addressing observational tensions in cosmology with systematics and fundamental physics
• Nested sampling for physical scientists
• The Dark Machines Anomaly Score Challenge: Benchmark Data and Model Independent Event Classification for the Large Hadron Collider
• What Fermilab $(g-2{)}_{\mu }$ experiment tells us about discovering SUSY at HL-LHC and HE-LHC
• SMEFiT: a flexible toolbox for global interpretations of particle physics data with effective field theories
• Quantum Optimisation of Complex Systems with a Quantum Annealer
• Simple and statistically sound recommendations for analysing physical theories
• Solving Key Challenges in Collider Physics with Foundation Models
• A comparison of Bayesian sampling algorithms for high-dimensional particle physics and cosmology applications
• Phenomenology of extended multiHiggs doublet models with $S_4$ family symmetry
• A Global Fit of Non-Relativistic Effective Dark Matter Operators Including Solar Neutrinos
• Non-Standard Neutrino Spectra From Annihilating Neutralino Dark Matter