Boosted Decision Trees as an Alternative to Artificial Neural Networks for Particle Identification

Abstract

The efficacy of particle identification is compared using artificial neutral networks and boosted decision trees. The comparison is performed in the context of the MiniBooNE, an experiment at Fermilab searching for neutrino oscillations. Based on studies of Monte Carlo samples of simulated data, particle identification with boosting algorithms has better performance than that with artificial neural networks for the MiniBooNE experiment. Although the tests in this paper were for one experiment, it is expected that boosting algorithms will find wide application in physics.

6 pages, 5 figures; Accepted for publication in Nucl. Inst. & Meth. A

References in corpus (1)

• Evidence for Neutrino Oscillations from the Observation of Electron Anti-neutrinos in a Muon Anti-Neutrino Beam

Cited by in corpus (197)

• Observation of a new boson at a mass of 125 GeV with the CMS experiment at the LHC
• Machine learning and the physical sciences
• Theory-guided Data Science: A New Paradigm for Scientific Discovery from Data
• CatBoost: unbiased boosting with categorical features
• Test of lepton universality using $B^{+}\to K^{+}{\ell }^{+}{\ell }^{-}$ decays
• Dark Matter Results from First 98.7-day Data of PandaX-II Experiment
• Direct detection of a break in the teraelectronvolt cosmic-ray spectrum of electrons and positrons
• A Search for Electron Neutrino Appearance at the Delta m**2 ~ 1 eV**2 Scale
• Efficient, reliable and fast high-level triggering using a bonsai boosted decision tree
• Search for the standard model Higgs boson produced in association with a W or a Z boson and decaying to bottom quarks
• Gamma-Hadron Separation in Very-High-Energy gamma-ray astronomy using a multivariate analysis method
• Search for the associated production of the Higgs boson with a top-quark pair
• Search for diphoton resonances in the mass range from 150 to 850 GeV in pp collisions at sqrt(s) = 8 TeV
• Performance of tau-lepton reconstruction and identification in CMS
• A search for the dimuon decay of the Standard Model Higgs boson with the ATLAS detector
• Search for electroweak production of charginos and neutralinos in multilepton final states in proton-proton collisions at $\sqrt{s}=$ 13 TeV
• Higgs boson pair production at the LHC in the $b\bar{b}{W}^{+}{W}^{-}$ channel
• ArborZ: Photometric Redshifts Using Boosted Decision Trees
• Evidence for production of single top quarks
• Evidence for production of single top quarks and first direct measurement of |Vtb|
• Observation of a new ${\Xi }_b^{-}$ resonance
• Evidence for the Higgs boson decay to a bottom quark-antiquark pair
• Search for the ${\Lambda }_b\to \Lambda {\eta }^{\prime }$ and ${\Lambda }_b\to \Lambda \eta$ decays with the LHCb detector
• Results of Dark Matter Search using the Full PandaX-II Exposure
• Measurements of $CP$ violation in the three-body phase space of charmless $B^{\pm }$ decays
• Multivariate discrimination and the Higgs + W/Z search
• Study of the production of ${\Lambda }_b^0$ and ${\overline{B}}^0$ hadrons in $pp$ collisions and first measurement of the ${\Lambda }_b^0\to J/\psi p{K}^{-}$ branching fraction
• Multi-year search for dark matter annihilations in the Sun with the AMANDA-II and IceCube detectors
• Studies of Boosted Decision Trees for MiniBooNE Particle Identification
• Fast inference of Boosted Decision Trees in FPGAs for particle physics
• Observation of two resonances in the ${\Lambda }_b^0{\pi }^{\pm }$ systems and precise measurement of ${\Sigma }_b^{\pm }$ and ${\Sigma }_b^{\ast \pm }$ properties
• W-jet Tagging: Optimizing the Identification of Boosted Hadronically-Decaying W Bosons
• How to Find More Supernovae with Less Work: Object Classification Techniques for Difference Imaging
• Search for direct production of supersymmetric partners of the top quark in the all-jets final state in proton-proton collisions at sqrt(s) = 13 TeV
• Top-philic dark matter within and beyond the WIMP paradigm
• Heavy Higgs Bosons at 14 TeV and 100 TeV
• Tagging a jet from a dark sector with Jet-substructures at colliders
• Observation of new resonances in the ${\Lambda }_b^0{\pi }^{+}{\pi }^{-}$ system
• Probing stop pair production at the LHC with graph neural networks
• Searches for the BSM scenarios at the LHC using decision tree based machine learning algorithms: A comparative study and review of Random Forest, Adaboost, XGboost and LightGBM frameworks
• First observation of the decay $B_{s2}^{\ast }(5840{)}^0\to B^{\ast +}{K}^{-}$ and studies of excited $B_s$ mesons
• Evolutionary algorithms for hyperparameter optimization in machine learning for application in high energy physics
• Improved $\gamma$/hadron separation for the detection of faint gamma-ray sources using boosted decision trees
• Unveiling CP property of top-Higgs coupling with graph neural networks at the LHC
• Search for D+(s) to pi+ mu+ mu- and D+(s) to pi- mu+ mu+ decays
• Measurement of the top quark pair cross section with ATLAS in pp collisions at sqrt(s) = 7 TeV using final states with an electron or a muon and a hadronically decaying tau lepton
• Supervised deep learning in high energy phenomenology: a mini review
• Search for resonant $\mathrm{t}\overline{\mathrm{t}}$ production in proton-proton collisions at $\sqrt{s}=$ 13 TeV
• Amplitude analysis of $B^{\pm }\to {\pi }^{\pm }{K}^{+}{K}^{-}$ decays
• Observation of top quark pairs produced in association with a vector boson in pp collisions at sqrt(s) = 8 TeV
• Type-II Seesaw Scalar Triplet Model at a 100 TeV $pp$ Collider: Discovery and Higgs Portal Coupling Determination
• Search for anomalous single top quark production in association with a photon in pp collisions at sqrt(s) = 8 TeV
• Observation of the production of three massive gauge bosons at $\sqrt{s}=$ 13 TeV
• Parallelizing MCMC with Random Partition Trees
• Optimizing EDELWEISS detectors for low-mass WIMP searches
• Machine Learning and Cosmological Simulations I: Semi-Analytical Models
• Search for the Dimuon Decay of the Higgs Boson in $pp$ Collisions at $\sqrt{s}$ = 13 TeV with the ATLAS Detector
• Observation of a new ${\Xi }_b^0$ state
• Measurement of $CP$ asymmetry in $B_s^0\to D_s^{\mp }{K}^{\pm }$ decays
• Measurement of $B^0$, $B_s^0$, $B^{+}$ and ${\Lambda }_b^0$ production asymmetries in 7 and 8 TeV proton-proton collisions
• Measurement of $CP$ asymmetries in two-body $B_{(s)}^0$-meson decays to charged pions and kaons
• Observation of $D^0$ meson decays to ${\pi }^{+}{\pi }^{-}{\mu }^{+}{\mu }^{-}$ and $K^{+}{K}^{-}{\mu }^{+}{\mu }^{-}$ final states
• Measurement of $CP$ observables in $B^{\pm }\to D{K}^{\pm }$ and $B^{\pm }\to D{\pi }^{\pm }$ with two- and four-body $D$ decays
• Studies of the resonance structure in $D^0\to K^{\mp }{\pi }^{\pm }{\pi }^{\pm }{\pi }^{\mp }$ decays
• Measurement of $CP$ observables in $B^{\pm }\to D^{(\ast )}{K}^{\pm }$ and $B^{\pm }\to D^{(\ast )}{\pi }^{\pm }$ decays
• Boosted decision trees in the era of new physics: a smuon analysis case study
• Search for lepton-number violating processes in B+ -> h- l+ l+ decays
• Photon-jet events as a probe of axion-like particles at the LHC
• Search for lepton-number violating B+ -> X- l+ l'+ decays
• Uncertainty in Gradient Boosting via Ensembles
• A search for charged massive long-lived particles
• Measuring anomalous WW$\gamma$ and t$\bar{\text{t}}\gamma$ couplings using top+$\gamma$ production at the LHC
• Observation of two new excited ${\Xi }_b^0$ states decaying to ${\Lambda }_b^0{K}^{-}{\pi }^{+}$
• Observation of ${\eta }_c(2S)\to p\bar{p}$ and search for $X(3872)\to p\bar{p}$ decays
• Application of artificial intelligence in the determination of impact parameter in heavy-ion collisions at intermediate energies
• Measurement of WZ and ZZ production in pp collisions at sqrt(s) = 8 TeV in final states with b-tagged jets
• Characterizing Higgs portal dark matter models at the ILC
• Towards the fate of natural composite Higgs model through single $t^{\prime }$ search at the 8 TeV LHC
• Observation of the annihilation decay mode $B^0\to K^{+}{K}^{-}$
• Observation of $B_c^{+}\to D^0{K}^{+}$ decays
• Search for heavy neutral leptons in $W^{+}\to {\mu }^{+}{\mu }^{\pm }\text{jet}$ decays
• QBDT, a new boosting decision tree method with systematic uncertainties into training for High Energy Physics
• Measurement of the $B^0$--${\bar{B}}^0$ oscillation frequency $\Delta m_d$ with the decays $B^0\to D^{-}{\pi }^{+}$ and $B^0\to J/\psi K^{\ast 0}$
• Statistical Classification Techniques for Photometric Supernova Typing
• Measurement of $CP$ observables in $B^{\pm }\to D^{(\ast )}{K}^{\pm }$ and $B^{\pm }\to D^{(\ast )}{\pi }^{\pm }$ decays using two-body $D$ final states
• Observation of the decay ${\Lambda }_b^0\to p{K}^{-}{\mu }^{+}{\mu }^{-}$ and a search for $CP$ violation
• Estimation of Impact Parameter and Transverse Spherocity in heavy-ion collisions at the LHC energies using Machine Learning
• Probing triple Higgs coupling with machine learning at the LHC
• Measurement of angular and CP asymmetries in $D^0\to {\pi }^{+}{\pi }^{-}{\mu }^{+}{\mu }^{-}$ and $D^0\to K^{+}{K}^{-}{\mu }^{+}{\mu }^{-}$ decays
• Effect of training characteristics on object classification: an application using Boosted Decision Trees
• Enriching the physics program of the CMS experiment via data scouting and data parking
• First observation of the decay $D^0\to K^{-}{\pi }^{+}{\mu }^{+}{\mu }^{-}$ in the ${\rho }^0$-$\omega$ region of the dimuon mass spectrum
• Measurement of the Bs effective lifetime in the J/psi f0(980) final state
• Hunting for top partner with a new signature at the LHC
• Search for $CP$ violation in ${\Lambda }_b^0\to p{K}^{-}$ and ${\Lambda }_b^0\to p{\pi }^{-}$ decays
• Polarization fraction measurement in same-sign WW scattering using deep learning
• Deep learning for the R-parity violating supersymmetry searches at the LHC
• Studies of Stability and Robustness for Artificial Neural Networks and Boosted Decision Trees
• Trees and Forests in Nuclear Physics
• Machine learning on Crays to optimise petrophysical workflows in oil and gas exploration
• Observation of $B_c^{+}\to J/\psi D^{(\ast )}{K}^{(\ast )}$ decays
• Polarization fraction measurement in ZZ scattering using deep learning
• Observation of new baryons in the ${\Xi }_b^{-}{\pi }^{+}{\pi }^{-}$ and ${\Xi }_b^0{\pi }^{+}{\pi }^{-}$ systems
• Measurement of the $B^{\pm }$ production asymmetry and the $CP$ asymmetry in $B^{\pm }\to J/\psi K^{\pm }$ decays
• Reconstructing boosted Higgs jets from event image segmentation
• Broad toplike vector quarks at LHC and HL-LHC
• Leptonic Scalars and Collider Signatures in a UV-complete Model
• Using the (Modified) Matrix Element Method to constrain $L_{\mu }-L_{\tau }$ Interactions
• Low energy electron/recoil discrimination for directional Dark Matter detection
• First evidence for the annihilation decay mode $B^{+}\to D_s^{+}\varphi$
• Deep learning predicted elliptic flow of identified particles in heavy-ion collisions at the RHIC and LHC energies
• Machine learning techniques in searches for $t\bar{t}h$ in the $h\to b\bar{b}$ decay channel
• Measurement of the top quark branching ratios into channels with leptons and quarks with the ATLAS detector
• Search for $B_c^{+}$ decays to two charm mesons
• Novel signatures for long-lived particles at the LHC
• A search for an eV-scale sterile neutrino using improved high-energy ${\nu }_{\mu }$ event reconstruction in IceCube
• Wedgebox analysis of four-lepton events from neutralino pair production at the LHC
• Amplitude analysis of the $B_{(s)}\to K^{\ast 0}{\overline{K}}^{\ast 0}$ decays and measurement of the branching fraction of the $B\to K^{\ast 0}{\overline{K}}^{\ast 0}$ decay
• Probing the $H^{\pm }{W}^{\mp }Z$ interaction at the high energy upgrade of the LHC
• Measurements of decay branching fractions of $H\to b\bar{b}/c\bar{c}/gg$ in associated $(e^{+}{e}^{-}/{\mu }^{+}{\mu }^{-})H$ production at the CEPC
• Angular analysis of $D^0\to {\pi }^{+}{\pi }^{-}{\mu }^{+}{\mu }^{-}$ and $D^0\to K^{+}{K}^{-}{\mu }^{+}{\mu }^{-}$ decays and search for $CP$ violation
• Fairness Implications of Encoding Protected Categorical Attributes
• Dissecting Jets and Missing Energy Searches Using $n$-body Extended Simplified Models
• Unveiling desert region in inert doublet model assisted by Peccei-Quinn symmetry
• Hadronic $b^{\prime }$ search at the LHC with top and W taggers
• Search for direct production of GeV-scale resonances decaying to a pair of muons in proton-proton collisions at $\sqrt{s}$ = 13 TeV
• Hadron Collider Searches for Diboson Resonances
• Probing the Top Quark Flavour-Changing Neutral Current at a Future Electron-Positron Collider
• Study of charmonium decays to $K_S^{0}K\pi$ in the $B\to (K_S^{0}K\pi )K$ channels
• First observation of the decays ${\bar{B}}_{(s)}^0\to D_s^{+}{K}^{-}{\pi }^{+}{\pi }^{-}$ and ${\bar{B}}_s^0\to D_{s1}(2536{)}^{+}{\pi }^{-}$
• LHC signals of triplet scalars as dark matter portal: cut-based approach and improvement with gradient boosting and neural networks
• Observation of the $B_s^0\to J/\psi \varphi \varphi$ decay
• Search for the $CP$-violating strong decays $\eta \to {\pi }^{+}{\pi }^{-}$ and ${\eta }^{\prime }(958)\to {\pi }^{+}{\pi }^{-}$
• Beam-Target Helicity Asymmetry $E$ in $K^0\Lambda$ and $K^0{\Sigma }^0$ Photoproduction on the Neutron
• Measurement of the CKM angle $\gamma$ using $B^0\to D{K}^{\ast 0}$ with $D\to K_S^0{\pi }^{+}{\pi }^{-}$ decays
• Interpolation Technique to Speed Up Gradients Propagation in Neural ODEs
• First observation of $B\to {\bar{D}}_1(\to \bar{D}{\pi }^{+}{\pi }^{-}){\ell }^{+}{\nu }_{\ell }$ and measurement of the $B\to {\bar{D}}^{(\ast )}\pi {\ell }^{+}{\nu }_{\ell }$ and $B\to {\bar{D}}^{(\ast )}{\pi }^{+}{\pi }^{-}{\ell }^{+}{\nu }_{\ell }$ branching fractions with hadronic tagging at Belle
• The degree profile and Gini index of random caterpillar trees
• Measurement of the ${\Lambda }_b^0\to \Lambda (1520){\mu }^{+}{\mu }^{-}$ differential branching fraction
• Applying Rule Ensembles to the Search for Super-Symmetry at the Large Hadron Collider
• Sensitivity to invisible Higgs boson decays at CLIC
• Using Machine Learning to Improve Neutron Identification in Water Cherenkov Detectors
• Study of background from accidental coincidence signals in the PandaX-II experiment
• Measurement of differential $b\bar{b}$- and $c\bar{c}$-dijet cross-sections in the forward region of $pp$ collisions at $\sqrt{s}=13\mathrm{TeV}$
• Measurements of triple-differential cross sections for inclusive isolated-photon+jet events in pp collisions at $\sqrt{s}=$ 8 TeV
• Search for Zgamma events with large missing transverse energy in ppbar collisions at sqrt(s)=1.96 TeV
• Implementing Reinforcement Learning Datacenter Congestion Control in NVIDIA NICs
• Measurement of the branching fraction of the $B^0\to D_s^{+}{\pi }^{-}$ decay
• Current Status of the MiniBooNE Experiment
• Interference Effect on Resonance Studies in Searches of Heavy Particles
• Optimize the event selection strategy to study the anomalous quartic gauge couplings at muon colliders using the support vector machine and quantum support vector machine
• Attention to the strengths of physical interactions: Transformer and graph-based event classification for particle physics experiments
• Updated search for $B_c^{+}$ decays to two charm mesons
• Particle Identification Using Boosted Decision Trees in the Semi-Digital Hadronic Calorimeter Prototype
• Extracting more from boosted decision trees: A high energy physics case study
• Search for $D^0$ meson decays to ${\pi }^{+}{\pi }^{-}{e}^{+}{e}^{-}$ and $K^{+}{K}^{-}{e}^{+}{e}^{-}$ final states
• Tracking the Identities of Boosted Particles
• On marginal feature attributions of tree-based models
• Which Heroes to Pick? Learning to Draft in MOBA Games with Neural Networks and Tree Search
• Prospects for Heavy Neutral Lepton Searches at Short and Medium Baseline Reactor Experiments
• Search for exotic long-lived particles at CLIC
• Event reconstruction with the proposed large area Cherenkov air shower detector SCORE
• Search for resonance-enhanced $CP$ and angular asymmetries in the ${\Lambda }_c^{+}\to p{\mu }^{+}{\mu }^{-}$ decay at LHCb
• Collider fingerprints of freeze-in dark matter produced during the fast expansion phase of Universe
• Probing highly collimated photon-jets with deep learning
• Cascade Training Technique for Particle Identification
• First observation and branching fraction measurement of the ${\Lambda }_b^0\to D_s^{-}p$ decay
• Neural networks for boosted di-$\tau$ identification
• Using Machine Learning to Select High-Quality Measurements
• Measurement of the $CP$ asymmetry in $B^{-}\to D_s^{-}{D}^0$ and $B^{-}\to D^{-}{D}^0$ decays
• A measurement of $\Delta {\Gamma }_s$
• A Comparison of Deep Learning Models for Proton Background Rejection with the AMS Electromagnetic Calorimeter
• Measurement of $CP$ asymmetry in $B_s^0\to D_s^{\mp }{K}^{\pm }$ decays
• New opportunities for rare charm from $Z\to c\bar{c}$ decays
• A Multivariate Training Technique with Event Reweighting
• Constraining nuclear effects in Argon using machine learning algorithms
• Self-regularizing restricted Boltzmann machines
• A search for new resonances in multiple final states with a high transverse momentum $Z$ boson in $\sqrt{s}=13$ TeV $pp$ collisions with the ATLAS detector
• Why every GBDT speed benchmark is wrong
• Detecting New Physics as Novelty -- Complementarity Matters
• Neutrino Oscillation Search at MiniBooNE
• A multivariate approach to heavy flavour tagging with cascade training
• Deep Neural Network as an alternative to Boosted Decision Trees for PID
• Event Classification with Multi-step Machine Learning
• Layout optimization for the LUXE-NPOD experiment
• Study of light-meson resonances decaying to $K_{\mathrm{S}}^{0}K\pi$ in the $B\to (K_{\mathrm{S}}^{0}K\pi )K$ channels
• Amplitude analysis of the radiative decay $B_s^0\to K^{+}{K}^{-}\gamma$
• Heavy Higgs Coupled to Vector-like Quarks: Strong CP Problem and Search Prospects at the 14 TeV LHC
• Subtractive Mixture Models via Squaring: Representation and Learning
• Measurements of $CP$ asymmetries and branching fraction ratios of $B^{-}$ decays to two charm mesons
• Surface waves prediction based on long-range acoustic backscattering in a mid-frequency range
• Deep-learning jet flavor tagging for precision hadronic Higgs measurements at future $e^{+}{e}^{-}$ Higgs factories
• Search for Lepton Flavor Violating Signals at the Future Electron-Proton Colliders
• Search for a Standard Model Higgs boson decaying to b quarks and produced in association with Z/W bosons with the CMS detector
• How to use Machine Learning to improve the discrimination between signal and background at particle colliders
• Searching for exotic Higgs bosons from top quark decays at the HL-LHC
• An Eager Splitting Strategy for Online Decision Trees