Anomaly Detection with Density Estimation
arXiv:2001.04990 · doi:10.1103/PhysRevD.101.075042
Abstract
We leverage recent breakthroughs in neural density estimation to propose a new unsupervised anomaly detection technique (ANODE). By estimating the probability density of the data in a signal region and in sidebands, and interpolating the latter into the signal region, a likelihood ratio of data vs. background can be constructed. This likelihood ratio is broadly sensitive to overdensities in the data that could be due to localized anomalies. In addition, a unique potential benefit of the ANODE method is that the background can be directly estimated using the learned densities. Finally, ANODE is robust against systematic differences between signal region and sidebands, giving it broader applicability than other methods. We demonstrate the power of this new approach using the LHC Olympics 2020 R\&D Dataset. We show how ANODE can enhance the significance of a dijet bump hunt by up to a factor of 7 with a 10\% accuracy on the background prediction. While the LHC is used as the recurring example, the methods developed here have a much broader applicability to anomaly detection in physics and beyond.
arXiv comment28 pages, 11 figures, v2: appendix on optimality, minor modifications, journal version
References in corpus (84)
- Adam: A Method for Stochastic Optimization
- PYTHIA 6.4 Physics and Manual
- PYTHIA 6.2 Physics and Manual
- TensorFlow: A system for large-scale machine learning
- The anti-k_t jet clustering algorithm
- A Brief Introduction to PYTHIA 8.1
- FastJet user manual
- DELPHES 3, A modular framework for fast simulation of a generic collider experiment
- Dispelling the N^3 myth for the Kt jet-finder
- Variational Inference with Normalizing Flows
- Identifying Boosted Objects with N-subjettiness
- Maximizing Boosted Top Identification by Minimizing N-subjettiness
- CaloGAN: Simulating 3D High Energy Particle Showers in Multi-Layer Electromagnetic Calorimeters with Generative Adversarial Networks
- Observation of Higgs boson production in association with a top quark pair at the LHC with the ATLAS detector
- MADE: Masked Autoencoder for Distribution Estimation
- Classification without labels: Learning from mixed samples in high energy physics
- Learning Particle Physics by Example: Location-Aware Generative Adversarial Networks for Physics Synthesis
- Accelerating Science with Generative Adversarial Networks: An Application to 3D Particle Showers in Multi-Layer Calorimeters
- Searching for New Physics with Deep Autoencoders
- Anomaly Detection for Resonant New Physics with Machine Learning
- Flow-based generative models for Markov chain Monte Carlo in lattice field theory
- Learning New Physics from a Machine
- Extending the Bump Hunt with Machine Learning
- How to GAN LHC Events
- Search for new resonances in mass distributions of jet pairs using 139 fb of collisions at TeV with the ATLAS detector
- QCD or What?
- A generic anti-QCD jet tagger
- Simulation Assisted Likelihood-free Anomaly Detection
- Novelty Detection Meets Collider Physics
- Adversarially-trained autoencoders for robust unsupervised new physics searches
- Search for high mass dijet resonances with a new background prediction method in proton-proton collisions at 13 TeV
- Guiding New Physics Searches with Unsupervised Learning
- Decorrelated Jet Substructure Tagging using Adversarial Neural Networks
- Variational Autoencoders for New Physics Mining at the Large Hadron Collider
- Precise simulation of electromagnetic calorimeter showers using a Wasserstein Generative Adversarial Network
- JUNIPR: a Framework for Unsupervised Machine Learning in Particle Physics
- Uncovering latent jet substructure
- Regressive and generative neural networks for scalar field theory
- Search for heavy resonances in the and final states using proton proton collisions at TeV with the ATLAS detector
- Measurements of Higgs boson properties in the diphoton decay channel in proton-proton collisions at 13 TeV
- Search for top-squark pair production in final states with one lepton, jets, and missing transverse momentum using 36 fb of TeV collision data with the ATLAS detector
- Fast and accurate simulation of particle detectors using generative adversarial networks
- DijetGAN: A Generative-Adversarial Network Approach for the Simulation of QCD Dijet Events at the LHC
- Thinking outside the ROCs: Designing Decorrelated Taggers (DDT) for jet substructure
- Global Search for New Physics with 2.0/fb at CDF
- Unfolding with Generative Adversarial Networks
- Search for long-lived particles produced in collisions at TeV that decay into displaced hadronic jets in the ATLAS muon spectrometer
- DisCo Fever: Robust Networks Through Distance Correlation
- Machine Learning Uncertainties with Adversarial Neural Networks
- A robust anomaly finder based on autoencoders
- Model-Independent and Quasi-Model-Independent Search for New Physics at CDF
- Search for New Physics in e mu X Data at D0 Using Sleuth: A Quasi-Model-Independent Search Strategy for New Physics
- A general search for new phenomena in ep scattering at HERA
- A strategy for a general search for new phenomena using data-derived signal regions and its application within the ATLAS experiment
- Fast simulation of muons produced at the SHiP experiment using Generative Adversarial Networks
- A Quasi-Model-Independent Search for New Physics at Large Transverse Momentum
- Deep Learning as a Parton Shower
- Lund jet images from generative and cycle-consistent adversarial networks
- A General Search for New Phenomena at HERA
- Generative Models for Fast Calorimeter Simulation.LHCb case
- Search for long-lived particles decaying into displaced jets in proton-proton collisions at 13 TeV
- Search for diboson resonances in hadronic final states in 139 fb of collisions at TeV with the ATLAS detector
- uBoost: A boosting method for producing uniform selection efficiencies from multivariate classifiers
- A Quasi-Model-Independent Search for New High p_T Physics at DZero
- A multi-dimensional search for new heavy resonances decaying to boosted WW, WZ, or ZZ boson pairs in the dijet final state at 13 TeV
- Convolved Substructure: Analytically Decorrelating Jet Substructure Observables
- GANs for generating EFT models
- Binary JUNIPR: an interpretable probabilistic model for discrimination
- Search for pair-produced resonances decaying to quark pairs in proton-proton collisions at 13 TeV
- LHC analysis-specific datasets with Generative Adversarial Networks
- Dedicated Strategies for Triboson Signals from Cascade Decays of Vector Resonances
- Search for new phenomena with large jet multiplicities and missing transverse momentum using large-radius jets and flavour-tagging at ATLAS in 13 TeV collisions
- Cherenkov Detectors Fast Simulation Using Neural Networks
- QBDT, a new boosting decision tree method with systematic uncertainties into training for High Energy Physics
- Neural Spline Flows
- Stealth multiboson signals
- Machine Learning Templates for QCD Factorization in the Search for Physics Beyond the Standard Model
- Detecting a Boosted Diboson Resonance
- Nonparametric semisupervised classification for signal detection in high energy physics
- Modeling Smooth Backgrounds and Generic Localized Signals with Gaussian Processes
- The motivation and status of two-body resonance decays after the LHC Run 2 and beyond
- Learning Multivariate New Physics
- The minimal stealth boson: models and benchmarks
- Model-Independent Global Search for New High-pT Physics at CDF
Cited by in corpus (119)
- A Unifying Review of Deep and Shallow Anomaly Detection
- Getting High: High Fidelity Simulation of High Granularity Calorimeters with High Speed
- Simulation Assisted Likelihood-free Anomaly Detection
- Dijet resonance search with weak supervision using TeV collisions in the ATLAS detector
- The Dark Machines Anomaly Score Challenge: Benchmark Data and Model Independent Event Classification for the Large Hadron Collider
- Machine Learning and LHC Event Generation
- Classifying Anomalies THrough Outer Density Estimation (CATHODE)
- Tag N' Train: A Technique to Train Improved Classifiers on Unlabeled Data
- Invertible Networks or Partons to Detector and Back Again
- Anomaly detection with Convolutional Graph Neural Networks
- CaloFlow: Fast and Accurate Generation of Calorimeter Showers with Normalizing Flows
- Finding New Physics without learning about it: Anomaly Detection as a tool for Searches at Colliders
- Understanding Event-Generation Networks via Uncertainties
- Better Latent Spaces for Better Autoencoders
- Variational Autoencoders for Anomalous Jet Tagging
- Simulation-Assisted Decorrelation for Resonant Anomaly Detection
- Interaction networks for the identification of boosted decays
- GANplifying Event Samples
- Bump Hunting in Latent Space
- Machine Learning for Anomaly Detection in Particle Physics
- Rare and Different: Anomaly Scores from a combination of likelihood and out-of-distribution models to detect new physics at the LHC
- ABCDisCo: Automating the ABCD Method with Machine Learning
- A guide for deploying Deep Learning in LHC searches: How to achieve optimality and account for uncertainty
- Casting a graph net to catch dark showers
- Challenges for Unsupervised Anomaly Detection in Particle Physics
- Resonant anomaly detection without background sculpting
- Quasi Anomalous Knowledge: Searching for new physics with embedded knowledge
- Unsupervised clustering for collider physics
- CURTAINs for your Sliding Window: Constructing Unobserved Regions by Transforming Adjacent Intervals
- Comparing Weak- and Unsupervised Methods for Resonant Anomaly Detection
- Online-compatible Unsupervised Non-resonant Anomaly Detection
- Mass Unspecific Supervised Tagging (MUST) for boosted jets
- Deep Set Auto Encoders for Anomaly Detection in Particle Physics
- Symmetries, Safety, and Self-Supervision
- FETA: Flow-Enhanced Transportation for Anomaly Detection
- Via Machinae: Searching for Stellar Streams using Unsupervised Machine Learning
- Improving Variational Autoencoders for New Physics Detection at the LHC with Normalizing Flows
- The LHC Olympics 2020: A Community Challenge for Anomaly Detection in High Energy Physics
- E Pluribus Unum Ex Machina: Learning from Many Collider Events at Once
- Unravelling physics beyond the standard model with classical and quantum anomaly detection
- How to Understand Limitations of Generative Networks
- Unsupervised Hadronic SUEP at the LHC
- Measuring QCD Splittings with Invertible Networks
- Jet Substructure from Dark Sector Showers
- Self-supervised Anomaly Detection for New Physics
- Learning new physics efficiently with nonparametric methods
- ν-Flows: Conditional Neutrino Regression
- Neural Network-based Top Tagger with Two-Point Energy Correlations and Geometry of Soft Emissions
- Learning the language of QCD jets with transformers
- The MadNIS Reloaded
- The Interplay of Machine Learning--based Resonant Anomaly Detection Methods
- The Hough Stream Spotter: A New Method for Detecting Linear Structure in Resolved Stars and Application to the Stellar Halo of M31
- An Iterative Method for Unsupervised Robust Anomaly Detection Under Data Contamination
- Deep Generative Models for Detector Signature Simulation: A Taxonomic Review
- What's Anomalous in LHC Jets?
- Anomaly Detection under Coordinate Transformations
- Anomaly detection from mass unspecific jet tagging
- IRC-safe Graph Autoencoder for unsupervised anomaly detection
- High-dimensional and Permutation Invariant Anomaly Detection
- Unsupervised in-distribution anomaly detection of new physics through conditional density estimation
- Learning Likelihood Ratios with Neural Network Classifiers
- Ephemeral Learning -- Augmenting Triggers with Online-Trained Normalizing Flows
- Nanosecond anomaly detection with decision trees and real-time application to exotic Higgs decays
- Boosting mono-jet searches with model-agnostic machine learning
- Precision-Machine Learning for the Matrix Element Method
- A semi-supervised approach to dark matter searches in direct detection data with machine learning
- A Method to Simultaneously Facilitate All Jet Physics Tasks
- Neural Embedding: Learning the Embedding of the Manifold of Physics Data
- GPU coprocessors as a service for deep learning inference in high energy physics
- Data-Directed Search for New Physics based on Symmetries of the SM
- Anomalies, Representations, and Self-Supervision
- Normalizing Flows for High-Dimensional Detector Simulations
- Anomaly Awareness
- Combining Resonant and Tail-based Anomaly Detection
- Calorimeter shower superresolution
- Convolutional L2LFlows: Generating Accurate Showers in Highly Granular Calorimeters Using Convolutional Normalizing Flows
- Differentiable MadNIS-Lite
- Non-Parametric Data-Driven Background Modelling using Conditional Probabilities
- Neural Bridge Sampling for Evaluating Safety-Critical Autonomous Systems
- Tagging boosted hadronic objects with dynamical grooming
- Enhancing the hunt for new phenomena in dijet final-states using anomaly detection filters at the High-Luminosity Large Hadron Collider
- Resonant Anomaly Detection with Multiple Reference Datasets
- Mixture-of-theories Training: Can We Find New Physics and Anomalies Better by Mixing Physical Theories?
- Jet tagging made easy
- Comparison of Affine and Rational Quadratic Spline Coupling and Autoregressive Flows through Robust Statistical Tests
- A Quantum Algorithm for Model-Independent Searches for New Physics
- Flows for Flows: Morphing one Dataset into another with Maximum Likelihood Estimation
- Anomaly detection with flow-based fast calorimeter simulators
- OneFlow: One-class flow for anomaly detection based on a minimal volume region
- Non-resonant Anomaly Detection with Background Extrapolation
- High-dimensional Anomaly Detection with Radiative Return in Collisions
- Weakly-Supervised Anomaly Detection in the Milky Way
- Exploring the ex-situ components within Gaia DR3
- Invariant Representation Driven Neural Classifier for Anti-QCD Jet Tagging
- Unsupervised and lightly supervised learning in particle physics
- Quantum density estimation with density matrices: Application to quantum anomaly detection
- Simulation-based Anomaly Detection for Multileptons at the LHC
- Detecting anomaly in vector boson scattering
- How to GAN Event Unweighting
- Generative Invertible Quantum Neural Networks
- TopicFlow: Disentangling quark and gluon jets with normalizing flows
- Finding Wombling Boundaries in LHC Data with Voronoi and Delaunay Tessellations
- Unifying Simulation and Inference with Normalizing Flows
- Signal-background interference for digluon resonances at the Large Hadron Collider
- Weakly supervised anomaly detection for resonant new physics in the dijet final state using proton-proton collisions at TeV with the ATLAS detector
- Latent Space Refinement for Deep Generative Models
- Exotic diboson decays in the USSM
- Fair Normalizing Flows
- New Methods and Datasets for Group Anomaly Detection From Fundamental Physics
- Learning New Physics from an Imperfect Machine
- Observable Optimization for Precision Theory: Machine Learning Energy Correlators
- Event Generation and Density Estimation with Surjective Normalizing Flows
- Detecting New Physics as Novelty -- Complementarity Matters
- Nonparametric Density Estimation from Markov Chains
- Preserving New Physics while Simultaneously Unfolding All Observables
- OmniLearned: A Foundation Model Framework for All Tasks Involving Jet Physics
- Creating Simple, Interpretable Anomaly Detectors for New Physics in Jet Substructure
- Reweighting and Analysing Event Generator Systematics by Neural Networks on High-Level Features
- Graph theory inspired anomaly detection at the LHC