QBDT, a new boosting decision tree method with systematic uncertainties into training for High Energy Physics

Abstract

A new boosting decision tree (BDT) method, QBDT, is proposed for the classification problem in the field of high energy physics (HEP). In many HEP researches, great efforts are made to increase the signal significance with the presence of huge background and various systematical uncertainties. Why not develop a BDT method targeting the significance directly? Indeed, the significance plays a central role in this new method. It is used to split a node in building a tree and to be also the weight contributing to the BDT score. As the systematical uncertainties can be easily included in the significance calculation, this method is able to learn about reducing the effect of the systematical uncertainties via training. Taking the search of the rare radiative Higgs decay in proton-proton collisions $pp\to h+X\to \gamma {\tau }^{+}{\tau }^{-}+X$ as example, QBDT and the popular Gradient BDT (GradBDT) method are compared. QBDT is found to reduce the correlation between the signal strength and systematical uncertainty sources and thus to give a better significance. The contribution to the signal strength uncertainty from the systematical uncertainty sources using the new method is 50-85~\% of that using the GradBDT method.

arXiv comment29 pages, accepted for publication in NIMA, algorithm available at https://github.com/xialigang/QBDT

References in corpus (13)

• PYTHIA 6.4 Physics and Manual
• PYTHIA 6.2 Physics and Manual
• The automated computation of tree-level and next-to-leading order differential cross sections, and their matching to parton shower simulations
• An Introduction to PYTHIA 8.2
• Asymptotic formulae for likelihood-based tests of new physics
• DELPHES 3, A modular framework for fast simulation of a generic collider experiment
• Identification of heavy-flavour jets with the CMS detector in pp collisions at 13 TeV
• Muon reconstruction performance of the ATLAS detector in proton--proton collision data at $\sqrt{s}$=13 TeV
• Boosted Decision Trees as an Alternative to Artificial Neural Networks for Particle Identification
• Performance of $b$-Jet Identification in the ATLAS Experiment
• Measurement of the photon identification efficiencies with the ATLAS detector using LHC Run-1 data
• Search for Higgs bosons produced via vector-boson fusion and decaying into bottom quark pairs in $\sqrt{s}=13$ $\mathrm{TeV}$ $pp$ collisions with the ATLAS detector
• Studies of Stability and Robustness for Artificial Neural Networks and Boosted Decision Trees

Cited by in corpus (17)

• Anomaly Detection with Density Estimation
• Simulation Assisted Likelihood-free Anomaly Detection
• Dijet resonance search with weak supervision using $\sqrt{s}=13$ TeV $pp$ collisions in the ATLAS detector
• Simulation-Assisted Decorrelation for Resonant Anomaly Detection
• ABCDisCo: Automating the ABCD Method with Machine Learning
• A guide for deploying Deep Learning in LHC searches: How to achieve optimality and account for uncertainty
• Uncertainty Aware Learning for High Energy Physics
• Quasi Anomalous Knowledge: Searching for new physics with embedded knowledge
• Online-compatible Unsupervised Non-resonant Anomaly Detection
• A Cautionary Tale of Decorrelating Theory Uncertainties
• Application of artificial intelligence in the determination of impact parameter in heavy-ion collisions at intermediate energies
• Reducing the dependence of the neural network function to systematic uncertainties in the input space
• A Holistic Approach to Predicting Top Quark Kinematic Properties with the Covariant Particle Transformer
• Enhancing searches for resonances with machine learning and moment decomposition
• Bias and Priors in Machine Learning Calibrations for High Energy Physics
• Dealing with Nuisance Parameters using Machine Learning in High Energy Physics: a Review
• Simulation-based Anomaly Detection for Multileptons at the LHC