A guide for deploying Deep Learning in LHC searches: How to achieve optimality and account for uncertainty

Abstract

Deep learning tools can incorporate all of the available information into a search for new particles, thus making the best use of the available data. This paper reviews how to optimally integrate information with deep learning and explicitly describes the corresponding sources of uncertainty. Simple illustrative examples show how these concepts can be applied in practice.

arXiv comment22 pages, 7 figures. v2: expanded discussion on removing sensitivity to theory nuisance parameters. v3: Updated with suggestions from referees

References in corpus (125)

• Adam: A Method for Stochastic Optimization
• Observation of a new particle in the search for the Standard Model Higgs boson with the ATLAS detector at the LHC
• Observation of a new boson at a mass of 125 GeV with the CMS experiment at the LHC
• TensorFlow: A system for large-scale machine learning
• Asymptotic formulae for likelihood-based tests of new physics
• Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)
• Confidence Level Computation for Combining Searches with Small Statistics
• Searching for Exotic Particles in High-Energy Physics with Deep Learning
• Jet energy scale and resolution in the CMS experiment in pp collisions at 8 TeV
• Fast inference of deep neural networks in FPGAs for particle physics
• ParticleNet: Jet Tagging via Particle Clouds
• Deep Learning and its Application to LHC Physics
• CaloGAN: Simulating 3D High Energy Particle Showers in Multi-Layer Electromagnetic Calorimeters with Generative Adversarial Networks
• Jet energy measurement and its systematic uncertainty in proton-proton collisions at $\sqrt{s}=7$ TeV with the ATLAS detector
• Jet Substructure at the Large Hadron Collider: A Review of Recent Advances in Theory and Machine Learning
• Anomaly Detection with Density Estimation
• Classification without labels: Learning from mixed samples in high energy physics
• Learning Particle Physics by Example: Location-Aware Generative Adversarial Networks for Physics Synthesis
• Deep learning in color: towards automated quark/gluon jet discrimination
• Jet-Images -- Deep Learning Edition
• Accelerating Science with Generative Adversarial Networks: An Application to 3D Particle Showers in Multi-Layer Calorimeters
• Deep-learning Top Taggers or The End of QCD?
• Searching for New Physics with Deep Autoencoders
• Anomaly Detection for Resonant New Physics with Machine Learning
• Jet Substructure Classification in High-Energy Physics with Deep Neural Networks
• Energy Flow Networks: Deep Sets for Particle Jets
• The Machine Learning Landscape of Top Taggers
• Parameterized Machine Learning for High-Energy Physics
• Flow-based generative models for Markov chain Monte Carlo in lattice field theory
• Learning New Physics from a Machine
• Extending the Bump Hunt with Machine Learning
• Deep-learned Top Tagging with a Lorentz Layer
• How to GAN LHC Events
• OmniFold: A Method to Simultaneously Unfold All Observables
• Mining gold from implicit models to improve likelihood-free inference
• QCD or What?
• A generic anti-QCD jet tagger
• Constraining Effective Field Theories with Machine Learning
• Simulation Assisted Likelihood-free Anomaly Detection
• Novelty Detection Meets Collider Physics
• Adversarially-trained autoencoders for robust unsupervised new physics searches
• A Guide to Constraining Effective Field Theories with Machine Learning
• Parton Shower Uncertainties in Jet Substructure Analyses with Deep Neural Networks
• Learning representations of irregular particle-detector geometry with distance-weighted graph networks
• Pulling Out All the Tops with Computer Vision and Deep Learning
• Guiding New Physics Searches with Unsupervised Learning
• The Lund Jet Plane
• Decorrelated Jet Substructure Tagging using Adversarial Neural Networks
• Approximating Likelihood Ratios with Calibrated Discriminative Classifiers
• Variational Autoencoders for New Physics Mining at the Large Hadron Collider
• JEDI-net: a jet identification algorithm based on interaction networks
• QCD-Aware Recursive Neural Networks for Jet Physics
• Pileup Mitigation with Machine Learning (PUMML)
• Precise simulation of electromagnetic calorimeter showers using a Wasserstein Generative Adversarial Network
• JUNIPR: a Framework for Unsupervised Machine Learning in Particle Physics
• Uncovering latent jet substructure
• Learning to Classify from Impure Samples with High-Dimensional Data
• Regressive and generative neural networks for scalar field theory
• Tag N' Train: A Technique to Train Improved Classifiers on Unlabeled Data
• Fast and accurate simulation of particle detectors using generative adversarial networks
• Neural Networks for Full Phase-space Reweighting and Parameter Tuning
• Boosting $H\to b\bar{b}$ with Machine Learning
• DijetGAN: A Generative-Adversarial Network Approach for the Simulation of QCD Dijet Events at the LHC
• Thinking outside the ROCs: Designing Decorrelated Taggers (DDT) for jet substructure
• How Much Information is in a Jet?
• How to GAN away Detector Effects
• Reweighting with Boosted Decision Trees
• Unfolding with Generative Adversarial Networks
• Novel Jet Observables from Machine Learning
• DisCo Fever: Robust Networks Through Distance Correlation
• Machine Learning Uncertainties with Adversarial Neural Networks
• Jet Charge and Machine Learning
• Interaction networks for the identification of boosted $H\to b\overline{b}$ decays
• A robust anomaly finder based on autoencoders
• (Machine) Learning to Do More with Less
• Quark-Gluon Tagging: Machine Learning vs Detector
• Fast simulation of muons produced at the SHiP experiment using Generative Adversarial Networks
• Deep-Learning Jets with Uncertainties and More
• Deep Learning as a Parton Shower
• Lund jet images from generative and cycle-consistent adversarial networks
• Interpretable Deep Learning for Two-Prong Jet Classification with Jet Spectra
• Generative Models for Fast Calorimeter Simulation.LHCb case
• INFERNO: Inference-Aware Neural Optimisation
• uBoost: A boosting method for producing uniform selection efficiencies from multivariate classifiers
• Lorentz Boost Networks: Autonomous Physics-Inspired Feature Engineering
• Boosted $W/Z$ Tagging with Jet Charge and Deep Learning
• Reweighting a parton shower using a neural network: the final-state case
• Observation of the decays ${\Lambda }_b^0\to {\chi }_{c1}p{K}^{-}$ and ${\Lambda }_b^0\to {\chi }_{c2}p{K}^{-}$
• Search for pair production of higgsinos in final states with at least three $b$-tagged jets in $\sqrt{s}=13$ TeV $pp$ collisions using the ATLAS detector
• Automating the Construction of Jet Observables with Machine Learning
• Convolved Substructure: Analytically Decorrelating Jet Substructure Observables
• Power-Constrained Limits
• GANs for generating EFT models
• Mass Agnostic Jet Taggers
• Infrared Safety of a Neural-Net Top Tagging Algorithm
• Jet Constituents for Deep Neural Network Based Top Quark Tagging
• Search for non-resonant Higgs boson pair production in the $bb\ell \nu \ell \nu$ final state with the ATLAS detector in $pp$ collisions at $\sqrt{s}=13$ TeV
• Binary JUNIPR: an interpretable probabilistic model for discrimination
• Electromagnetic Showers Beyond Shower Shapes
• LHC analysis-specific datasets with Generative Adversarial Networks
• Reports of My Demise Are Greatly Exaggerated: $N$-subjettiness Taggers Take On Jet Images
• Long Short-Term Memory (LSTM) networks with jet constituents for boosted top tagging at the LHC
• The DNNLikelihood: enhancing likelihood distribution with Deep Learning
• Opening the black box of neural nets: case studies in stop/top discrimination
• Cherenkov Detectors Fast Simulation Using Neural Networks
• QBDT, a new boosting decision tree method with systematic uncertainties into training for High Energy Physics
• Spectral Analysis of Jet Substructure with Neural Networks: Boosted Higgs Case
• Quark-Gluon Jet Discrimination Using Convolutional Neural Networks
• Topology classification with deep learning to improve real-time event selection at the LHC
• Deep learning for the R-parity violating supersymmetry searches at the LHC
• Machine Learning Templates for QCD Factorization in the Search for Physics Beyond the Standard Model
• Reducing the dependence of the neural network function to systematic uncertainties in the input space
• Towards a new generation of parton densities with deep learning models
• Applying Bayesian Neural Networks to Event Reconstruction in Reactor Neutrino Experiments
• CapsNets Continuing the Convolutional Quest
• Jet grooming through reinforcement learning
• Study of energy deposition patterns in hadron calorimeter for prompt and displaced jets using convolutional neural network
• Significance Variables
• Machine learning approach to inverse problem and unfolding procedure
• Learning Multivariate New Physics
• Identifying the relevant dependencies of the neural network response on characteristics of the input space
• Investigating the Quantum Properties of Jets and the Search for a Supersymmetric Top Quark Partner with the ATLAS Detector
• Towards automation of data quality system for CERN CMS experiment
• Improving the measurement of the Higgs boson-gluon coupling using convolutional neural networks at $e^{+}{e}^{-}$ colliders
• Importance and construction of features in identifying new physics signals with deep learning

Cited by in corpus (29)

• OmniFold: A Method to Simultaneously Unfold All Observables
• Simulation Assisted Likelihood-free Anomaly Detection
• Machine Learning and LHC Event Generation
• Understanding Event-Generation Networks via Uncertainties
• Generative Networks for Precision Enthusiasts
• A Neural Resampler for Monte Carlo Reweighting with Preserved Uncertainties
• The Present and Future of QCD
• A factorisation-aware Matrix element emulator
• Casting a graph net to catch dark showers
• Uncertainty Aware Learning for High Energy Physics
• Learning the latent structure of collider events
• Mapping Machine-Learned Physics into a Human-Readable Space
• Presenting Unbinned Differential Cross Section Results
• Per-Object Systematics using Deep-Learned Calibration
• The LHC Olympics 2020: A Community Challenge for Anomaly Detection in High Energy Physics
• Boosted decision trees in the era of new physics: a smuon analysis case study
• Energy-weighted Message Passing: an infra-red and collinear safe graph neural network algorithm
• Towards Machine Learning Analytics for Jet Substructure
• A Cautionary Tale of Decorrelating Theory Uncertainties
• Combine and Conquer: Event Reconstruction with Bayesian Ensemble Neural Networks
• Learning Likelihood Ratios with Neural Network Classifiers
• Null Hypothesis Test for Anomaly Detection
• A method for approximating optimal statistical significances with machine-learned likelihoods
• Bias and Priors in Machine Learning Calibrations for High Energy Physics
• Interpretable deep learning models for the inference and classification of LHC data
• Learning Feynman integrals from differential equations with neural networks
• Exploring the Universality of Hadronic Jet Classification
• Observable Optimization for Precision Theory: Machine Learning Energy Correlators
• Boosted and semi-boosted all-hadronic $t\bar{t}$ reconstruction performance on kinematic variables for selected BSM models using a 2D extesion of the BumpHunter algorithm