Semi-Supervised Anomaly Detection - Towards Model-Independent Searches of New Physics

Abstract

Most classification algorithms used in high energy physics fall under the category of supervised machine learning. Such methods require a training set containing both signal and background events and are prone to classification errors should this training data be systematically inaccurate for example due to the assumed MC model. To complement such model-dependent searches, we propose an algorithm based on semi-supervised anomaly detection techniques, which does not require a MC training sample for the signal data. We first model the background using a multivariate Gaussian mixture model. We then search for deviations from this model by fitting to the observations a mixture of the background model and a number of additional Gaussians. This allows us to perform pattern recognition of any anomalous excess over the background. We show by a comparison to neural network classifiers that such an approach is a lot more robust against misspecification of the signal MC than supervised classification. In cases where there is an unexpected signal, a neural network might fail to correctly identify it, while anomaly detection does not suffer from such a limitation. On the other hand, when there are no systematic errors in the training data, both methods perform comparably.

Proceedings of ACAT 2011 conference (Uxbridge, UK), 9 pages, 4 figures

References in corpus (1)

• Model-Independent and Quasi-Model-Independent Search for New Physics at CDF

Cited by in corpus (20)

• Learning New Physics from a Machine
• Novelty Detection Meets Collider Physics
• Guiding New Physics Searches with Unsupervised Learning
• Quasi Anomalous Knowledge: Searching for new physics with embedded knowledge
• The LHC Olympics 2020: A Community Challenge for Anomaly Detection in High Energy Physics
• Using a nested anomaly detection machine learning algorithm to study the neutral triple gauge couplings at an \texorpdfstring{$e^{+}{e}^{-}$}{e+e-} collider
• Detecting anomalous quartic gauge couplings using the isolation forest machine learning algorithm
• Searching for anomalous quartic gauge couplings at muon colliders using principle component analysis
• A semi-supervised approach to dark matter searches in direct detection data with machine learning
• Neural Embedding: Learning the Embedding of the Manifold of Physics Data
• Matrix Element Regression with Deep Neural Networks -- breaking the CPU barrier
• Enhancing the hunt for new phenomena in dijet final-states using anomaly detection filters at the High-Luminosity Large Hadron Collider
• Using k-means assistant event selection strategy to study anomalous quartic gauge couplings at muon colliders
• Detect anomalous quartic gauge couplings at muon colliders with quantum kernel k-means
• Searching for gluon quartic gauge couplings at muon colliders using the auto-encoder
• Optimize the event selection strategy to study the anomalous quartic gauge couplings at muon colliders using the support vector machine and quantum support vector machine
• Advances in Multi-Variate Analysis Methods for New Physics Searches at the Large Hadron Collider
• Search for anomalous quartic gauge couplings in the process ${\mu }^{+}{\mu }^{-}\to \bar{\nu }\nu \gamma \gamma$ with a nested local outlier factor
• A quantum machine learning classifier to search for new physics
• Trials Factor for Semi-Supervised NN Classifiers in Searches for Narrow Resonances at the LHC