Online-compatible Unsupervised Non-resonant Anomaly Detection

Abstract

There is a growing need for anomaly detection methods that can broaden the search for new particles in a model-agnostic manner. Most proposals for new methods focus exclusively on signal sensitivity. However, it is not enough to select anomalous events - there must also be a strategy to provide context to the selected events. We propose the first complete strategy for unsupervised detection of non-resonant anomalies that includes both signal sensitivity and a data-driven method for background estimation. Our technique is built out of two simultaneously-trained autoencoders that are forced to be decorrelated from each other. This method can be deployed offline for non-resonant anomaly detection and is also the first complete online-compatible anomaly detection strategy. We show that our method achieves excellent performance on a variety of signals prepared for the ADC2021 data challenge.

arXiv comment9 pages, 3 figures

References in corpus (78)

• Adam: A Method for Stochastic Optimization
• Auto-Encoding Variational Bayes
• Observation of a new particle in the search for the Standard Model Higgs boson with the ATLAS detector at the LHC
• Observation of a new boson at a mass of 125 GeV with the CMS experiment at the LHC
• PYTHIA 6.4 Physics and Manual
• PYTHIA 6.2 Physics and Manual
• An Introduction to PYTHIA 8.2
• FastJet user manual
• DELPHES 3, A modular framework for fast simulation of a generic collider experiment
• An Introduction to Variational Autoencoders
• Dispelling the N^3 myth for the Kt jet-finder
• Brownian distance covariance
• The CMS trigger system
• Fast inference of deep neural networks in FPGAs for particle physics
• Anomaly Detection with Density Estimation
• Searching for New Physics with Deep Autoencoders
• Anomaly Detection for Resonant New Physics with Machine Learning
• Learning New Physics from a Machine
• Extending the Bump Hunt with Machine Learning
• Automatic heterogeneous quantization of deep neural networks for low-latency inference on the edge for particle detectors
• A generic anti-QCD jet tagger
• QCD or What?
• Operation of the ATLAS trigger system in Run 2
• Simulation Assisted Likelihood-free Anomaly Detection
• Novelty Detection Meets Collider Physics
• Adversarially-trained autoencoders for robust unsupervised new physics searches
• Dijet resonance search with weak supervision using $\sqrt{s}=13$ TeV $pp$ collisions in the ATLAS detector
• Fast convolutional neural networks on FPGAs with hls4ml
• Guiding New Physics Searches with Unsupervised Learning
• Decorrelated Jet Substructure Tagging using Adversarial Neural Networks
• Variational Autoencoders for New Physics Mining at the Large Hadron Collider
• The Dark Machines Anomaly Score Challenge: Benchmark Data and Model Independent Event Classification for the Large Hadron Collider
• Uncovering latent jet substructure
• Autoencoders for unsupervised anomaly detection in high energy physics
• Tag N' Train: A Technique to Train Improved Classifiers on Unlabeled Data
• Anomaly detection with Convolutional Graph Neural Networks
• Thinking outside the ROCs: Designing Decorrelated Taggers (DDT) for jet substructure
• Learning to Pivot with Adversarial Networks
• A Living Review of Machine Learning for Particle Physics
• Finding New Physics without learning about it: Anomaly Detection as a tool for Searches at Colliders
• Better Latent Spaces for Better Autoencoders
• Simulation-Assisted Decorrelation for Resonant Anomaly Detection
• DisCo Fever: Robust Networks Through Distance Correlation
• Machine Learning Uncertainties with Adversarial Neural Networks
• A robust anomaly finder based on autoencoders
• Bump Hunting in Latent Space
• ABCDisCo: Automating the ABCD Method with Machine Learning
• Rare and Different: Anomaly Scores from a combination of likelihood and out-of-distribution models to detect new physics at the LHC
• A deep neural network to search for new long-lived particles decaying to jets
• Learning the latent structure of collider events
• Challenges for Unsupervised Anomaly Detection in Particle Physics
• Quasi Anomalous Knowledge: Searching for new physics with embedded knowledge
• Unsupervised clustering for collider physics
• uBoost: A boosting method for producing uniform selection efficiencies from multivariate classifiers
• Comparing Weak- and Unsupervised Methods for Resonant Anomaly Detection
• Deep Set Auto Encoders for Anomaly Detection in Particle Physics
• Mass Unspecific Supervised Tagging (MUST) for boosted jets
• Transferability of Deep Learning Models in Searches for New Physics at Colliders
• Use of a Generalized Energy Mover's Distance in the Search for Rare Phenomena at Colliders
• Via Machinae: Searching for Stellar Streams using Unsupervised Machine Learning
• Unsupervised Outlier Detection in Heavy-Ion Collisions
• The LHC Olympics 2020: A Community Challenge for Anomaly Detection in High Energy Physics
• Anomalous Jet Identification via Sequence Modeling
• Topological Obstructions to Autoencoding
• Convolved Substructure: Analytically Decorrelating Jet Substructure Observables
• Mass Agnostic Jet Taggers
• A Cautionary Tale of Decorrelating Theory Uncertainties
• QBDT, a new boosting decision tree method with systematic uncertainties into training for High Energy Physics
• Nanosecond machine learning event classification with boosted decision trees in FPGA for high energy physics
• Reducing the dependence of the neural network function to systematic uncertainties in the input space
• Unsupervised in-distribution anomaly detection of new physics through conditional density estimation
• Nonparametric semisupervised classification for signal detection in high energy physics
• Decoding Dark Matter Substructure without Supervision
• Unsupervised Event Classification with Graphs on Classical and Photonic Quantum Computers
• Uncovering hidden patterns in collider events with Bayesian probabilistic models
• Real-time Artificial Intelligence for Accelerator Control: A Study at the Fermilab Booster
• An Exploration of Learnt Representations of W Jets
• New approaches for boosting to uniformity

Cited by in corpus (16)

• Anomaly detection in high-energy physics using a quantum autoencoder
• Machine Learning for Anomaly Detection in Particle Physics
• Deep Generative Models for Detector Signature Simulation: A Taxonomic Review
• What's Anomalous in LHC Jets?
• Anomaly Detection under Coordinate Transformations
• Nanosecond anomaly detection with decision trees and real-time application to exotic Higgs decays
• Boosting mono-jet searches with model-agnostic machine learning
• Neural Embedding: Learning the Embedding of the Manifold of Physics Data
• Anomalies, Representations, and Self-Supervision
• A method for approximating optimal statistical significances with machine-learned likelihoods
• Enhancing the hunt for new phenomena in dijet final-states using anomaly detection filters at the High-Luminosity Large Hadron Collider
• Semi-visible jets, energy-based models, and self-supervision
• Non-resonant Anomaly Detection with Background Extrapolation
• Unsupervised and lightly supervised learning in particle physics
• Creating Simple, Interpretable Anomaly Detectors for New Physics in Jet Substructure
• Graph theory inspired anomaly detection at the LHC