Nanosecond machine learning event classification with boosted decision trees in FPGA for high energy physics

Abstract

We present a novel implementation of classification using the machine learning / artificial intelligence method called boosted decision trees (BDT) on field programmable gate arrays (FPGA). The firmware implementation of binary classification requiring 100 training trees with a maximum depth of 4 using four input variables gives a latency value of about 10 ns, independent of the clock speed from 100 to 320 MHz in our setup. The low timing values are achieved by restructuring the BDT layout and reconfiguring its parameters. The FPGA resource utilization is also kept low at a range from 0.01% to 0.2% in our setup. A software package called fwXmachina achieves this implementation. Our intended user is an expert of custom electronics-based trigger systems in high energy physics experiments or anyone that needs decisions at the lowest latency values for real-time event classification. Two problems from high energy physics are considered, in the separation of electrons vs. photons and in the selection of vector boson fusion-produced Higgs bosons vs. the rejection of the multijet processes.

arXiv comment66 pages, 27 figures, 13 tables, JINST version

References in corpus (42)

• Scikit-learn: Machine Learning in Python
• Observation of a new particle in the search for the Standard Model Higgs boson with the ATLAS detector at the LHC
• Observation of a new boson at a mass of 125 GeV with the CMS experiment at the LHC
• The automated computation of tree-level and next-to-leading order differential cross sections, and their matching to parton shower simulations
• The anti-k_t jet clustering algorithm
• An Introduction to PYTHIA 8.2
• DELPHES 3, A modular framework for fast simulation of a generic collider experiment
• Performance of the ATLAS Trigger System in 2015
• The CMS trigger system
• TMVA - Toolkit for Multivariate Data Analysis
• Fast inference of deep neural networks in FPGAs for particle physics
• Performance of $b$-Jet Identification in the ATLAS Experiment
• The Physics of the B Factories
• Measurement of the $Z/{\gamma }^{\ast }$ boson transverse momentum distribution in $pp$ collisions at $\sqrt{s}$ = 7 TeV with the ATLAS detector
• Exotic Decays of the 125 GeV Higgs Boson
• Performance of electron and photon triggers in ATLAS during LHC Run 2
• CaloGAN: Simulating 3D High Energy Particle Showers in Multi-Layer Electromagnetic Calorimeters with Generative Adversarial Networks
• Performance of the ATLAS Trigger System in 2010
• Performance of the CMS Level-1 trigger in proton-proton collisions at $\sqrt{s}=$ 13 TeV
• Accelerating Science with Generative Adversarial Networks: An Application to 3D Particle Showers in Multi-Layer Calorimeters
• Search for invisible decays of a Higgs boson produced through vector boson fusion in proton-proton collisions at $\sqrt{s}=$ 13 TeV
• Measurement of the Inelastic Proton-Proton Cross Section at $\sqrt{s}=13$ TeV with the ATLAS Detector at the LHC
• Delphes, a framework for fast simulation of a generic collider experiment
• Automatic heterogeneous quantization of deep neural networks for low-latency inference on the edge for particle detectors
• Measurements of $b$-jet tagging efficiency with the ATLAS detector using $t\bar{t}$ events at $\sqrt{s}=13$ TeV
• Fast convolutional neural networks on FPGAs with hls4ml
• Difficult Scenarios for NMSSM Higgs Discovery at the LHC
• Evidence for production of single top quarks and first direct measurement of |Vtb|
• Compressing deep neural networks on FPGAs to binary and ternary precision with HLS4ML
• Readiness of the ATLAS Liquid Argon Calorimeter for LHC Collisions
• Fast inference of Boosted Decision Trees in FPGAs for particle physics
• Search for the Higgs boson produced in association with a vector boson and decaying into two spin-zero particles in the $H\to aa\to 4b$ channel in $pp$ collisions at $\sqrt{s}=13$ TeV with the ATLAS detector
• Search for invisible Higgs boson decays in vector boson fusion at $\sqrt{s}=13$ TeV with the ATLAS detector
• Ps and Qs: Quantization-aware pruning for efficient low latency neural network inference
• Distance-Weighted Graph Neural Networks on FPGAs for Real-Time Particle Reconstruction in High Energy Physics
• Search for Higgs boson decays into two new low-mass spin-0 particles in the 4$b$ channel with the ATLAS detector using $pp$ collisions at $\sqrt{s}=13$ TeV
• Performance of the ATLAS Level-1 topological trigger in Run 2
• Electromagnetic Showers Beyond Shower Shapes
• Accelerated Charged Particle Tracking with Graph Neural Networks on FPGAs
• Performance of the upgraded PreProcessor of the ATLAS Level-1 Calorimeter Trigger
• A neural network z-vertex trigger for Belle II
• Real-time Artificial Intelligence for Accelerator Control: A Study at the Fermilab Booster

Cited by in corpus (10)

• Autoencoders on FPGAs for real-time, unsupervised new physics detection at 40 MHz at the Large Hadron Collider
• Online-compatible Unsupervised Non-resonant Anomaly Detection
• Nanosecond anomaly detection with decision trees and real-time application to exotic Higgs decays
• Ephemeral Learning -- Augmenting Triggers with Online-Trained Normalizing Flows
• Nanosecond machine learning regression with deep boosted decision trees in FPGA for high energy physics
• Ultrafast jet classification on FPGAs for the HL-LHC
• Development of a resource-efficient FPGA-based neural network regression model for the ATLAS muon trigger upgrades
• BitHEP -- The Limits of Low-Precision ML in HEP
• Nanosecond hardware regression trees in FPGA at the LHC
• Illuminating all-hadronic final states with a photon: Exotic decays of the Higgs boson to four bottom quarks in vector boson fusion plus gamma at hadron colliders