Boosted decision trees in the era of new physics: a smuon analysis case study

Abstract

Machine learning algorithms are growing increasingly popular in particle physics analyses, where they are used for their ability to solve difficult classification and regression problems. While the tools are very powerful, they may often be under- or mis-utilised. In the following, we investigate the use of gradient boosting techniques as applicable to a generic particle physics problem. We use as an example a Beyond the Standard Model smuon collider analysis which applies to both current and future hadron colliders, and we compare our results to a traditional cut-and-count approach. In particular, we interrogate the use of metrics in imbalanced datasets which are characteristic of high energy physics problems, offering an alternative to the widely used area under the curve (auc) metric through a novel use of the F-score metric. We present an in-depth comparison of feature selection and investigation using a principal component analysis, Shapley values, and feature permutation methods in a way which we hope will be widely applicable to future particle physics analyses. Moreover, we show that a machine learning model can extend the 95% confidence level exclusions obtained in a traditional cut-and-count analysis, while potentially bypassing the need for complicated feature selections. Finally, we discuss the possibility of constructing a general machine learning model which is applicable to probe a two-dimensional mass plane.

arXiv comment35 pages, 7 images

References in corpus (49)

• XGBoost: A Scalable Tree Boosting System
• The automated computation of tree-level and next-to-leading order differential cross sections, and their matching to parton shower simulations
• The anti-k_t jet clustering algorithm
• A Brief Introduction to PYTHIA 8.1
• FastJet user manual
• Asymptotic formulae for likelihood-based tests of new physics
• DELPHES 3, A modular framework for fast simulation of a generic collider experiment
• FeynRules 2.0 - A complete toolbox for tree-level phenomenology
• Machine learning and the physical sciences
• UFO - The Universal FeynRules Output
• Learning When Training Data are Costly: The Effect of Class Distribution on Tree Induction
• Measuring masses of semi-invisibly decaying particles pair produced at hadron colliders
• Automatic spin-entangled decays of heavy resonances in Monte Carlo simulations
• Matching matrix elements and shower evolution for top-quark production in hadronic collisions
• Parton distributions with QED corrections
• Boosted Decision Trees as an Alternative to Artificial Neural Networks for Particle Identification
• Deep Learning and its Application to LHC Physics
• Jet Substructure at the Large Hadron Collider: A Review of Recent Advances in Theory and Machine Learning
• Search for electroweak production of charginos and sleptons decaying into final states with two leptons and missing transverse momentum in $\sqrt{s}=13$ TeV $pp$ collisions using the ATLAS detector
• Precision predictions for electroweak superpartner production at hadron colliders with Resummino
• QCD radiation in the production of heavy colored particles at the LHC
• A comprehensive approach to new physics simulations
• Minimal Kinematic Constraints and MT2
• Dark Matter at Colliders: a Model-Independent Approach
• Constraining Effective Field Theories with Machine Learning
• Computing decay rates for new physics theories with FeynRules and MadGraph5/aMC@NLO
• A Guide to Constraining Effective Field Theories with Machine Learning
• Machine and Deep Learning Applications in Particle Physics
• Evidence for the associated production of a W boson and a top quark in ATLAS at sqrt(s) = 7 TeV
• Evidence for production of single top quarks and first direct measurement of |Vtb|
• Observation of Single Top Quark Production and Measurement of |Vtb| with CDF
• Search for supersymmetry in final states with two oppositely charged same-flavor leptons and missing transverse momentum in proton-proton collisions at $\sqrt{s}=$ 13 TeV
• Revisiting slepton pair production at the Large Hadron Collider
• A superspace module for the FeynRules package
• Auto-WEKA: Combined Selection and Hyperparameter Optimization of Classification Algorithms
• Heavy Neutrinos with Dynamic Jet Vetoes: Multilepton Searches at $\sqrt{s}=14,27,$ and $100$ TeV
• Threshold Resummation for Slepton-Pair Production at Hadron Colliders
• Studies of Boosted Decision Trees for MiniBooNE Particle Identification
• Lower Limit on Dark Matter Production at the Large Hadron Collider
• Modern Machine Learning and Particle Physics
• A guide for deploying Deep Learning in LHC searches: How to achieve optimality and account for uncertainty
• Search for bottom-squark pair production with the ATLAS detector in final states containing Higgs bosons, $b$-jets and missing transverse momentum
• Measurement of CP-Violating Asymmetries in B0->D(*)+D-
• Safe Jet Vetoes
• Machine Learning in High Energy Physics Community White Paper
• On the impact of selected modern deep-learning techniques to the performance and celerity of classification models in an experimental high-energy physics use case
• Sleptons without Hadrons
• Resonance Searches with Machine Learned Likelihood Ratios
• Extracting more from boosted decision trees: A high energy physics case study

Cited by in corpus (17)

• Searches for the BSM scenarios at the LHC using decision tree based machine learning algorithms: A comparative study and review of Random Forest, Adaboost, XGboost and LightGBM frameworks
• Machine learning the trilinear and light-quark Yukawa couplings from Higgs pair kinematic shapes
• Learning to Identify Semi-Visible Jets
• Improving sensitivity of trilinear RPV SUSY searches using machine learning at the LHC
• Beyond Cuts in Small Signal Scenarios -- Enhanced Sneutrino Detectability Using Machine Learning
• Using Machine Learning to Improve Neutron Identification in Water Cherenkov Detectors
• Boosted top tagging and its interpretation using Shapley values
• Slepton searches in the trilinear RPV SUSY scenarios at the HL-LHC and HE-LHC
• Extracting Higgs Self-Coupling Constraints through Triple Higgs Boson Production at Future Hadron Colliders
• Optimal sensitivity of anomalous charged triple gauge couplings through $W$ boson helicity at the $e^{+}{e}^{-}$ colliders
• Higgs couplings in SMEFT via Zh production at the HL-LHC
• Prospects for exotic $h\to 4\tau$ decays in single and di-Higgs boson production at the LHC and future hadron colliders
• Improving smuon searches with Neural Networks
• Searching for top-philic heavy resonances in boosted four-top final states
• Moiré Topology in Twisted Structures with Noncollinear Spin-Orbit Coupling
• The Physics Behind ML-based Quark-Gluon Taggers
• How to use Machine Learning to improve the discrimination between signal and background at particle colliders