ABCDisCo: Automating the ABCD Method with Machine Learning

Abstract

The ABCD method is one of the most widely used data-driven background estimation techniques in high energy physics. Cuts on two statistically-independent classifiers separate signal and background into four regions, so that background in the signal region can be estimated simply using the other three control regions. Typically, the independent classifiers are chosen "by hand" to be intuitive and physically motivated variables. Here, we explore the possibility of automating the design of one or both of these classifiers using machine learning. We show how to use state-of-the-art decorrelation methods to construct powerful yet independent discriminators. Along the way, we uncover a previously unappreciated aspect of the ABCD method: its accuracy hinges on having low signal contamination in control regions not just overall, but relative to the signal fraction in the signal region. We demonstrate the method with three examples: a simple model consisting of three-dimensional Gaussians; boosted hadronic top jet tagging; and a recasted search for paired dijet resonances. In all cases, automating the ABCD method with machine learning significantly improves performance in terms of ABCD closure, background rejection and signal contamination.

arXiv comment37 pages, 12 figures

References in corpus (108)

• Adam: A Method for Stochastic Optimization
• PYTHIA 6.4 Physics and Manual
• PYTHIA 6.2 Physics and Manual
• TensorFlow: A system for large-scale machine learning
• The anti-k_t jet clustering algorithm
• An Introduction to PYTHIA 8.2
• FastJet user manual
• DELPHES 3, A modular framework for fast simulation of a generic collider experiment
• Measuring and testing dependence by correlation of distances
• Dispelling the N^3 myth for the Kt jet-finder
• Searching for Exotic Particles in High-Energy Physics with Deep Learning
• Identifying Boosted Objects with N-subjettiness
• Brownian distance covariance
• Identification of heavy-flavour jets with the CMS detector in pp collisions at 13 TeV
• SUSY Les Houches Accord: Interfacing SUSY Spectrum Calculators, Decay Packages, and Event Generators
• Top-tagging: A Method for Identifying Boosted Hadronic Tops
• ParticleNet: Jet Tagging via Particle Clouds
• SUSY Les Houches Accord 2
• Deep Learning and its Application to LHC Physics
• Maximizing Boosted Top Identification by Minimizing N-subjettiness
• Jet Substructure at the Large Hadron Collider: A Review of Recent Advances in Theory and Machine Learning
• Anomaly Detection with Density Estimation
• Deep learning in color: towards automated quark/gluon jet discrimination
• Jet-Images -- Deep Learning Edition
• Deep-learning Top Taggers or The End of QCD?
• Searching for New Physics with Deep Autoencoders
• Anomaly Detection for Resonant New Physics with Machine Learning
• Energy Flow Networks: Deep Sets for Particle Jets
• The Machine Learning Landscape of Top Taggers
• Parameterized Machine Learning for High-Energy Physics
• Learning New Physics from a Machine
• Extending the Bump Hunt with Machine Learning
• Deep-learned Top Tagging with a Lorentz Layer
• Jet Flavor Classification in High-Energy Physics with Deep Neural Networks
• Jet-Images: Computer Vision Inspired Techniques for Jet Tagging
• A generic anti-QCD jet tagger
• QCD or What?
• Identification of heavy, energetic, hadronically decaying particles using machine-learning techniques
• Simulation Assisted Likelihood-free Anomaly Detection
• Novelty Detection Meets Collider Physics
• Adversarially-trained autoencoders for robust unsupervised new physics searches
• Parton Shower Uncertainties in Jet Substructure Analyses with Deep Neural Networks
• Energy flow polynomials: A complete linear basis for jet substructure
• Learning representations of irregular particle-detector geometry with distance-weighted graph networks
• Dijet resonance search with weak supervision using $\sqrt{s}=13$ TeV $pp$ collisions in the ATLAS detector
• Pulling Out All the Tops with Computer Vision and Deep Learning
• Guiding New Physics Searches with Unsupervised Learning
• Approximating Likelihood Ratios with Calibrated Discriminative Classifiers
• Decorrelated Jet Substructure Tagging using Adversarial Neural Networks
• Variational Autoencoders for New Physics Mining at the Large Hadron Collider
• JEDI-net: a jet identification algorithm based on interaction networks
• QCD-Aware Recursive Neural Networks for Jet Physics
• Uncovering latent jet substructure
• Calorimetry with Deep Learning: Particle Simulation and Reconstruction for Collider Physics
• Learning to Classify from Impure Samples with High-Dimensional Data
• Search for pair-produced resonances decaying to jet pairs in proton-proton collisions at sqrt(s) = 8 TeV
• Tag N' Train: A Technique to Train Improved Classifiers on Unlabeled Data
• Boosting $H\to b\bar{b}$ with Machine Learning
• Thinking outside the ROCs: Designing Decorrelated Taggers (DDT) for jet substructure
• How Much Information is in a Jet?
• Graph Neural Networks for Particle Reconstruction in High Energy Physics detectors
• Recursive Neural Networks in Quark/Gluon Tagging
• A Living Review of Machine Learning for Particle Physics
• Finding New Physics without learning about it: Anomaly Detection as a tool for Searches at Colliders
• Variational Autoencoders for Anomalous Jet Tagging
• Novel Jet Observables from Machine Learning
• DisCo Fever: Robust Networks Through Distance Correlation
• A search for pair-produced resonances in four-jet final states at $\sqrt{s}$ =13 TeV with the ATLAS detector
• Machine Learning Uncertainties with Adversarial Neural Networks
• Interaction networks for the identification of boosted $H\to b\overline{b}$ decays
• Jet Charge and Machine Learning
• A robust anomaly finder based on autoencoders
• Quark-Gluon Tagging: Machine Learning vs Detector
• A deep neural network to search for new long-lived particles decaying to jets
• Learning the latent structure of collider events
• Evolution of average multiplicities of quark and gluon jets
• Interpretable Deep Learning for Two-Prong Jet Classification with Jet Spectra
• INFERNO: Inference-Aware Neural Optimisation
• uBoost: A boosting method for producing uniform selection efficiencies from multivariate classifiers
• Boosted $W/Z$ Tagging with Jet Charge and Deep Learning
• Search for Higgs boson decays into pairs of light (pseudo)scalar particles in the $\gamma \gamma jj$ final state in $pp$ collisions at $\sqrt{s}=13$ TeV with the ATLAS detector
• Transferability of Deep Learning Models in Searches for New Physics at Colliders
• Automating the Construction of Jet Observables with Machine Learning
• Energy dependence of mean multiplicities in gluon and quark jets at the next-to-next-to-next-to-leading order
• Convolved Substructure: Analytically Decorrelating Jet Substructure Observables
• Search for new phenomena in final states with large jet multiplicities and missing transverse momentum using $\sqrt{(}s)=13$ TeV proton$-$proton collisions recorded by ATLAS in Run 2 of the LHC
• Mass Agnostic Jet Taggers
• Towards Machine Learning Analytics for Jet Substructure
• Electromagnetic Showers Beyond Shower Shapes
• Search for pair-produced resonances decaying to quark pairs in proton-proton collisions at $\sqrt{s}=$ 13 TeV
• Neural Network-based Top Tagger with Two-Point Energy Correlations and Geometry of Soft Emissions
• Reports of My Demise Are Greatly Exaggerated: $N$-subjettiness Taggers Take On Jet Images
• QBDT, a new boosting decision tree method with systematic uncertainties into training for High Energy Physics
• Search for Higgs boson decays into a $Z$ boson and a light hadronically decaying resonance using 13 TeV $pp$ collision data from the ATLAS detector
• Search for supersymmetry in pp collisions at $\sqrt{s}=$ 13 TeV with 137 fb${}^{-1}$ in final states with a single lepton using the sum of masses of large-radius jets
• Probing triple Higgs coupling with machine learning at the LHC
• Topology classification with deep learning to improve real-time event selection at the LHC
• Reducing the dependence of the neural network function to systematic uncertainties in the input space
• A search for top squarks with R-parity-violating decays to all-hadronic final states with the ATLAS detector in $\sqrt{s}$ = 8 TeV proton-proton collisions
• CapsNets Continuing the Convolutional Quest
• Optimal statistical inference in the presence of systematic uncertainties using neural network optimization based on binned Poisson likelihoods with nuisance parameters
• Nonparametric semisupervised classification for signal detection in high energy physics
• Fast convolutional neural networks for identifying long-lived particles in a high-granularity calorimeter
• Pileup mitigation at the Large Hadron Collider with Graph Neural Networks
• Dealing with Nuisance Parameters using Machine Learning in High Energy Physics: a Review
• Strange Jet Tagging
• Improved Extrapolation Methods of Data-driven Background Estimation in High-Energy Physics
• New approaches for boosting to uniformity

Cited by in corpus (32)

• Simulation-Assisted Decorrelation for Resonant Anomaly Detection
• Modern Machine Learning and Particle Physics
• Machine Learning for Anomaly Detection in Particle Physics
• Uncertainty Aware Learning for High Energy Physics
• Quasi Anomalous Knowledge: Searching for new physics with embedded knowledge
• Online-compatible Unsupervised Non-resonant Anomaly Detection
• Symmetries, Safety, and Self-Supervision
• Search for displaced leptons in $\sqrt{s}=13$ TeV $pp$ collisions with the ATLAS detector
• A Cautionary Tale of Decorrelating Theory Uncertainties
• Search for supersymmetry in final states with disappearing tracks in proton-proton collisions at $\sqrt{s}$ = 13 TeV
• Search for pair-produced vector-like leptons in final states with third-generation leptons and at least three b quark jets in proton-proton collisions at $\sqrt{s}$ = 13 TeV
• Enhancing searches for resonances with machine learning and moment decomposition
• Search for long-lived particles decaying in the CMS muon detectors in proton-proton collisions at $\sqrt{s}$ = 13 TeV
• Data-driven Estimation of Background Distribution through Neural Autoregressive Flows
• Search for long-lived particles using displaced vertices and missing transverse momentum in proton-proton collisions at $\sqrt{s}$ = 13 TeV
• Bias and Priors in Machine Learning Calibrations for High Energy Physics
• Bayesian Probabilistic Modelling for Four-Tops at the LHC
• Search for neutral long-lived particles that decay into displaced jets in the ATLAS calorimeter in association with leptons or jets using $pp$ collisions at $\sqrt{s}=13$ TeV
• Non-resonant Anomaly Detection with Background Extrapolation
• Measurement of the $Z$ boson production cross-section in proton-lead collisions at $\sqrt{s_{\mathrm{NN}}}=8.16\mathrm{TeV}$
• Unsupervised and lightly supervised learning in particle physics
• Invariant Representation Driven Neural Classifier for Anti-QCD Jet Tagging
• Improvement and generalization of ABCD method with Bayesian inference
• Search for pairs of muons with small displacements in $pp$ collisions at $\sqrt{s}=13$ TeV with the ATLAS detector
• Designing Observables for Measurements with Deep Learning
• Data-driven method to estimate contamination from light ion beam transmutation at colliders
• Search for pair-produced higgsinos decaying via Higgs or $Z$ bosons to final states containing a pair of photons and a pair of $b$-jets with the ATLAS detector
• Search for b hadron decays to long-lived particles in the CMS endcap muon detectors
• Solving Combinatorial Problems at Particle Colliders Using Machine Learning
• Data driven background estimation in HEP using Generative Adversarial Networks
• Inferring correlated distributions: boosted top jets
• Machine learning in top quark physics at ATLAS and CMS