Machine Learning in High Energy Physics: A review of heavy-flavor jet tagging at the LHC

Abstract

The application of machine learning (ML) in high energy physics (HEP), specifically in heavy-flavor jet tagging at Large Hadron Collider (LHC) experiments, has experienced remarkable growth and innovation in the past decade. This review provides a detailed examination of current and past ML techniques in this domain. It starts by exploring various data representation methods and ML architectures, encompassing traditional ML algorithms and advanced deep learning techniques. Subsequent sections discuss specific instances of successful ML applications in jet flavor tagging in the ATLAS and CMS experiments at the LHC, ranging from basic fully-connected layers to graph neural networks employing attention mechanisms. To systematically categorize the advancements over the LHC's three runs, the paper classifies jet tagging algorithms into three generations, each characterized by specific data representation techniques and ML architectures. This classification aims to provide an overview of the chronological evolution in this field. Finally, a brief discussion about anticipated future developments and potential research directions in the field is presented.

arXiv comment38 pages, 2 tables, 1 figure

References in corpus (120)

• XGBoost: A Scalable Tree Boosting System
• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• Observation of a new particle in the search for the Standard Model Higgs boson with the ATLAS detector at the LHC
• Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
• Observation of a new boson at a mass of 125 GeV with the CMS experiment at the LHC
• The anti-k_t jet clustering algorithm
• FastJet user manual
• Deep Residual Learning for Image Recognition
• Geometric deep learning: going beyond Euclidean data
• Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
• Better Jet Clustering Algorithms
• Jet substructure as a new Higgs search channel at the LHC
• Identifying Boosted Objects with N-subjettiness
• A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decay
• Identification of heavy-flavour jets with the CMS detector in pp collisions at 13 TeV
• Identification of b-quark jets with the CMS experiment
• Top-tagging: A Method for Identifying Boosted Hadronic Tops
• Performance of $b$-Jet Identification in the ATLAS Experiment
• ParticleNet: Jet Tagging via Particle Clouds
• A portrait of the Higgs boson by the CMS experiment ten years after the discovery
• Energy Correlation Functions for Jet Substructure
• Deep Learning and its Application to LHC Physics
• Jet reconstruction and performance using particle flow with the ATLAS Detector
• ATLAS $b$-jet identification performance and efficiency measurement with $t\bar{t}$ events in $pp$ collisions at $\sqrt{s}=13$ TeV
• Maximizing Boosted Top Identification by Minimizing N-subjettiness
• Pileup Per Particle Identification
• Exotic Decays of the 125 GeV Higgs Boson
• Jet Substructure at the Large Hadron Collider: A Review of Recent Advances in Theory and Machine Learning
• Fat Jets for a Light Higgs
• Observation of Higgs boson decay to bottom quarks
• Jet Substructure at the Large Hadron Collider: Experimental Review
• Classification without labels: Learning from mixed samples in high energy physics
• Observation of $H\to b\bar{b}$ decays and $VH$ production with the ATLAS detector
• Deep learning in color: towards automated quark/gluon jet discrimination
• Jet-Images -- Deep Learning Edition
• Deep-learning Top Taggers or The End of QCD?
• Jet Substructure Classification in High-Energy Physics with Deep Neural Networks
• Energy Flow Networks: Deep Sets for Particle Jets
• The Machine Learning Landscape of Top Taggers
• Recurrent Neural Networks for Multivariate Time Series with Missing Values
• Jet Flavour Classification Using DeepJet
• Gaining (Mutual) Information about Quark/Gluon Discrimination
• Quark and Gluon Tagging at the LHC
• Deep-learned Top Tagging with a Lorentz Layer
• Jet Flavor Classification in High-Energy Physics with Deep Neural Networks
• New Angles on Energy Correlation Functions
• Jet-Images: Computer Vision Inspired Techniques for Jet Tagging
• Search for new resonances in mass distributions of jet pairs using 139 fb${}^{-1}$ of $pp$ collisions at $\sqrt{s}=13$ TeV with the ATLAS detector
• Identification of heavy, energetic, hadronically decaying particles using machine-learning techniques
• Quark and Gluon Jet Substructure
• ATLAS flavour-tagging algorithms for the LHC Run 2 $pp$ collision dataset
• Energy flow polynomials: A complete linear basis for jet substructure
• Finding top quarks with shower deconstruction
• Top Tagging
• Measurements of $b$-jet tagging efficiency with the ATLAS detector using $t\bar{t}$ events at $\sqrt{s}=13$ TeV
• Pulling Out All the Tops with Computer Vision and Deep Learning
• JEDI-net: a jet identification algorithm based on interaction networks
• QCD-Aware Recursive Neural Networks for Jet Physics
• An Efficient Lorentz Equivariant Graph Neural Network for Jet Tagging
• Pileup Mitigation with Machine Learning (PUMML)
• JUNIPR: a Framework for Unsupervised Machine Learning in Particle Physics
• Learning to Classify from Impure Samples with High-Dimensional Data
• Search for Higgs boson pair production in the $b\bar{b}b\bar{b}$ final state from $pp$ collisions at $\sqrt{s}=8$ TeV with the ATLAS detector
• Jets with Variable R
• Measurement of the $c$-jet mistagging efficiency in $t\bar{t}$ events using $pp$ collision data at $\sqrt{s}=13$ TeV collected with the ATLAS detector
• ABCNet: An attention-based method for particle tagging
• Anomaly detection with Convolutional Graph Neural Networks
• Casimir Meets Poisson: Improved Quark/Gluon Discrimination with Counting Observables
• Recursive Neural Networks in Quark/Gluon Tagging
• Deep Sets
• Measurement of B anti-B Angular Correlations based on Secondary Vertex Reconstruction at sqrt(s)=7 TeV
• Calibration of the light-flavour jet mistagging efficiency of the $b$-tagging algorithms with $Z$+jets events using 139 ${\mathrm{fb}}^{-1}$ of ATLAS proton-proton collision data at $\sqrt{s}=13$ TeV
• W-jet Tagging: Optimizing the Identification of Boosted Hadronically-Decaying W Bosons
• Jet Charge and Machine Learning
• Lorentz Group Equivariant Neural Network for Particle Physics
• A robust anomaly finder based on autoencoders
• Probing stop pair production at the LHC with graph neural networks
• FPGA-accelerated machine learning inference as a service for particle physics computing
• XCone: N-jettiness as an Exclusive Cone Jet Algorithm
• Quark-Gluon Tagging: Machine Learning vs Detector
• A search for the standard model Higgs boson decaying to charm quarks
• Unveiling CP property of top-Higgs coupling with graph neural networks at the LHC
• Quark-Gluon tagging with Shower Deconstruction: Unearthing dark matter and Higgs couplings
• How to Improve Top Tagging
• Associated jet and subjet rates in light-quark and gluon jet discrimination
• Optimisation of large-radius jet reconstruction for the ATLAS detector in 13 TeV proton-proton collisions
• Supervised Jet Clustering with Graph Neural Networks for Lorentz Boosted Bosons
• Equivariant Energy Flow Networks for Jet Tagging
• Lorentz Boost Networks: Autonomous Physics-Inspired Feature Engineering
• Direct constraint on the Higgs-charm coupling from a search for Higgs boson decays into charm quarks with the ATLAS detector
• Search for Higgs boson decays into two new low-mass spin-0 particles in the 4$b$ channel with the ATLAS detector using $pp$ collisions at $\sqrt{s}=13$ TeV
• End-to-End Jet Classification of Quarks and Gluons with the CMS Open Data
• Identification of boosted Higgs bosons decaying into $b$-quark pairs with the ATLAS detector at 13 TeV
• Self-supervised Auxiliary Learning with Meta-paths for Heterogeneous Graphs
• Quarks and gluons in the Lund plane
• A deep neural network for simultaneous estimation of b jet energy and resolution
• Search for Higgs boson decay to a charm quark-antiquark pair in proton-proton collisions at $\sqrt{s}$ = 13 TeV
• Jet Constituents for Deep Neural Network Based Top Quark Tagging
• Neural Network-based Top Tagger with Two-Point Energy Correlations and Geometry of Soft Emissions
• Reports of My Demise Are Greatly Exaggerated: $N$-subjettiness Taggers Take On Jet Images
• Long Short-Term Memory (LSTM) networks with jet constituents for boosted top tagging at the LHC
• Benchmarking an Even Better HEPTopTagger
• NormFormer: Improved Transformer Pretraining with Extra Normalization
• A new tagger for hadronically decaying heavy particles at the LHC
• Resolving Boosted Jets with XCone
• A new calibration method for charm jet identification validated with proton-proton collision events at $\sqrt{s}$ = 13 TeV
• CapsNets Continuing the Convolutional Quest
• Secondary Vertex Finding in Jets with Neural Networks
• Activation Functions in Deep Learning: A Comprehensive Survey and Benchmark
• Set2Graph: Learning Graphs From Sets
• Identification of b-jets using QCD-inspired observables
• Boosted top quark tagging and polarization measurement using machine learning
• Dynamic Radius Jet Clustering Algorithm
• BIP: Boost Invariant Polynomials for Efficient Jet Tagging
• Search for Higgs boson and observation of Z boson through their decay into a charm quark-antiquark pair in boosted topologies in proton-proton collisions at $\sqrt{s}$ = 13 TeV
• Pileup and Infrared Radiation Annihilation (PIRANHA): A Paradigm for Continuous Jet Grooming
• A Wavelet Based Pile-Up Mitigation Method for the LHC Upgrade
• Improving Robustness of Jet Tagging Algorithms with Adversarial Training
• Hunting for bumps in the margins
• Flavour tagging with graph neural networks with the ATLAS detector

Cited by in corpus (10)

• Tagging more quark jet flavours at FCC-ee at 91 GeV with a transformer-based neural network
• Reconstruction of boosted and resolved multi-Higgs-boson events with symmetry-preserving attention networks
• Machine-Learning Analysis of Radiative Decays to Dark Matter at the LHC
• From strange-quark tagging to fragmentation tagging with machine learning
• Systematically Constructing the Likelihood for Boosted $H\to gg$ Decays
• B-jet Tagging Using a Hybrid Edge Convolution and Transformer Architecture
• Shedding Light on Dark Matter at the LHC with Machine Learning
• Exploring an image-based $b$-jet tagging method using convolution neural networks
• Tagging ultra-boosted jets at FCC-hh using machine learning techniques
• TIGER: A Topology-Agnostic, Hierarchical Graph Network for Event Reconstruction