Ephemeral Learning -- Augmenting Triggers with Online-Trained Normalizing Flows

Abstract

The large data rates at the LHC require an online trigger system to select relevant collisions. Rather than compressing individual events, we propose to compress an entire data set at once. We use a normalizing flow as a deep generative model to learn the probability density of the data online. The events are then represented by the generative neural network and can be inspected offline for anomalies or used for other analysis purposes. We demonstrate our new approach for a toy model and a correlation-enhanced bump hunt.

arXiv comment17 pages, 9 figures, minor changes to text, addressed referee comments

References in corpus (32)

• SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
• The anti-k_t jet clustering algorithm
• A Brief Introduction to PYTHIA 8.1
• FastJet user manual
• DELPHES 3, A modular framework for fast simulation of a generic collider experiment
• Variational Inference with Normalizing Flows
• Normalizing Flows: An Introduction and Review of Current Methods
• Identifying Boosted Objects with N-subjettiness
• The CMS trigger system
• Identification of heavy-flavour jets with the CMS detector in pp collisions at 13 TeV
• Maximizing Boosted Top Identification by Minimizing N-subjettiness
• MADE: Masked Autoencoder for Distribution Estimation
• Anomaly Detection with Density Estimation
• Classification without labels: Learning from mixed samples in high energy physics
• Anomaly Detection for Resonant New Physics with Machine Learning
• Event Generation with Normalizing Flows
• Extending the Bump Hunt with Machine Learning
• Operation of the ATLAS trigger system in Run 2
• Simulation Assisted Likelihood-free Anomaly Detection
• Search for narrow resonances in dijet final states at sqrt(s) = 8 TeV with the novel CMS technique of data scouting
• Classifying Anomalies THrough Outer Density Estimation (CATHODE)
• Tesla : an application for real-time data analysis in High Energy Physics
• Search for low-mass dijet resonances using trigger-level jets with the ATLAS detector in $pp$ collisions at $\sqrt{s}=13$ TeV
• On hypothesis testing, trials factor, hypertests and the BumpHunter
• Understanding Event-Generation Networks via Uncertainties
• Applications and Techniques for Fast Machine Learning in Science
• Targeting Multi-Loop Integrals with Neural Networks
• A comprehensive real-time analysis model at the LHCb experiment
• Practical Lossless Compression with Latent Variables using Bits Back Coding
• IDF++: Analyzing and Improving Integer Discrete Flows for Lossless Compression
• CaloFlow II: Even Faster and Still Accurate Generation of Calorimeter Showers with Normalizing Flows
• Nanosecond machine learning event classification with boosted decision trees in FPGA for high energy physics

Cited by in corpus (12)

• Machine Learning and LHC Event Generation
• MadNIS -- Neural Multi-Channel Importance Sampling
• The MadNIS Reloaded
• Anomaly Detection under Coordinate Transformations
• CaloFlow for CaloChallenge Dataset 1
• Calorimeter shower superresolution
• Differentiable MadNIS-Lite
• Anomaly detection with flow-based fast calorimeter simulators
• TopicFlow: Disentangling quark and gluon jets with normalizing flows
• Unifying Simulation and Inference with Normalizing Flows
• Foundations of automatic feature extraction at LHC--point clouds and graphs
• Observable Optimization for Precision Theory: Machine Learning Energy Correlators