The LHC Olympics 2020: A Community Challenge for Anomaly Detection in High Energy Physics

Abstract

A new paradigm for data-driven, model-agnostic new physics searches at colliders is emerging, and aims to leverage recent breakthroughs in anomaly detection and machine learning. In order to develop and benchmark new anomaly detection methods within this framework, it is essential to have standard datasets. To this end, we have created the LHC Olympics 2020, a community challenge accompanied by a set of simulated collider events. Participants in these Olympics have developed their methods using an R&D dataset and then tested them on black boxes: datasets with an unknown anomaly (or not). This paper will review the LHC Olympics 2020 challenge, including an overview of the competition, a description of methods deployed in the competition, lessons learned from the experience, and implications for data analyses with future datasets as well as future colliders.

arXiv comment108 pages, 53 figures, 3 tables

References in corpus (92)

• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• Auto-Encoding Variational Bayes
• Observation of a new particle in the search for the Standard Model Higgs boson with the ATLAS detector at the LHC
• Observation of a new boson at a mass of 125 GeV with the CMS experiment at the LHC
• PYTHIA 6.4 Physics and Manual
• PYTHIA 6.2 Physics and Manual
• Improving neural networks by preventing co-adaptation of feature detectors
• The anti-k_t jet clustering algorithm
• An Introduction to PYTHIA 8.2
• FastJet user manual
• mixup: Beyond Empirical Risk Minimization
• DELPHES 3, A modular framework for fast simulation of a generic collider experiment
• Herwig++ Physics and Manual
• Dispelling the N^3 myth for the Kt jet-finder
• Focal Loss for Dense Object Detection
• Variational Inference with Normalizing Flows
• Normalizing Flows: An Introduction and Review of Current Methods
• Fast Graph Representation Learning with PyTorch Geometric
• Identifying Boosted Objects with N-subjettiness
• A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decay
• Density estimation using Real NVP
• Muon reconstruction performance of the ATLAS detector in proton--proton collision data at $\sqrt{s}$=13 TeV
• Rethinking the Inception Architecture for Computer Vision
• Big Self-Supervised Models are Strong Semi-Supervised Learners
• Fast inference of deep neural networks in FPGAs for particle physics
• Trial factors for the look elsewhere effect in high energy physics
• Deep Learning and its Application to LHC Physics
• Maximizing Boosted Top Identification by Minimizing N-subjettiness
• Pileup Per Particle Identification
• Anomaly Detection with Density Estimation
• Classification without labels: Learning from mixed samples in high energy physics
• Searching for New Physics with Deep Autoencoders
• Anomaly Detection for Resonant New Physics with Machine Learning
• An Overview of Deep Semi-Supervised Learning
• The Machine Learning Landscape of Top Taggers
• Parameterized Machine Learning for High-Energy Physics
• Learning New Physics from a Machine
• Extending the Bump Hunt with Machine Learning
• How to GAN LHC Events
• OmniFold: A Method to Simultaneously Unfold All Observables
• Search for new resonances in mass distributions of jet pairs using 139 fb${}^{-1}$ of $pp$ collisions at $\sqrt{s}=13$ TeV with the ATLAS detector
• QCD or What?
• Mining gold from implicit models to improve likelihood-free inference
• Search for narrow and broad dijet resonances in proton-proton collisions at $\sqrt{s}=$ 13 TeV and constraints on dark matter mediators and other new particles
• Simulation Assisted Likelihood-free Anomaly Detection
• The RooStats Project
• Adversarially-trained autoencoders for robust unsupervised new physics searches
• A Guide to Constraining Effective Field Theories with Machine Learning
• Dijet resonance search with weak supervision using $\sqrt{s}=13$ TeV $pp$ collisions in the ATLAS detector
• Variational Autoencoders for New Physics Mining at the Large Hadron Collider
• Uncovering latent jet substructure
• ABCNet: An attention-based method for particle tagging
• On the Topic of Jets: Disentangling Quarks and Gluons at Colliders
• Neural Networks for Full Phase-space Reweighting and Parameter Tuning
• How Much Information is in a Jet?
• On hypothesis testing, trials factor, hypertests and the BumpHunter
• Global Search for New Physics with 2.0/fb at CDF
• A Living Review of Machine Learning for Particle Physics
• Simulation-Assisted Decorrelation for Resonant Anomaly Detection
• RECAST: Extending the Impact of Existing Analyses
• Novel Jet Observables from Machine Learning
• DisCo Fever: Robust Networks Through Distance Correlation
• Model-Independent and Quasi-Model-Independent Search for New Physics at CDF
• The Tracking Machine Learning challenge : Accuracy phase
• Search for New Physics in e mu X Data at D0 Using Sleuth: A Quasi-Model-Independent Search Strategy for New Physics
• A general search for new phenomena in ep scattering at HERA
• A strategy for a general search for new phenomena using data-derived signal regions and its application within the ATLAS experiment
• Search for diboson resonances with boson-tagged jets in $pp$ collisions at $\sqrt{s}=13$ TeV with the ATLAS detector
• An operational definition of quark and gluon jets
• A guide for deploying Deep Learning in LHC searches: How to achieve optimality and account for uncertainty
• A Quasi-Model-Independent Search for New Physics at Large Transverse Momentum
• A Point Set Generation Network for 3D Object Reconstruction from a Single Image
• FSPool: Learning Set Representations with Featurewise Sort Pooling
• Learning the latent structure of collider events
• Quasi Anomalous Knowledge: Searching for new physics with embedded knowledge
• Unsupervised clustering for collider physics
• LHC Signals from Cascade Decays of Warped Vector Resonances
• A General Search for New Phenomena at HERA
• A measurement of the calorimeter response to single hadrons and determination of the jet energy scale uncertainty using LHC Run-1 $pp$-collision data with the ATLAS detector
• Search for massive resonances decaying into WW, WZ or ZZ bosons in proton-proton collisions at sqrt(s) = 13 TeV
• A Quasi-Model-Independent Search for New High p_T Physics at DZero
• Measurement of the $\mathrm{t}\bar{\mathrm{t}}\mathrm{b}\bar{\mathrm{b}}$ production cross section in the all-jet final state in pp collisions at $\sqrt{s}=$ 13 TeV
• Flavor Universal Resonances and Warped Gravity
• Properties of jet fragmentation using charged particles measured with the ATLAS detector in $pp$ collisions at $\sqrt{s}=13$ TeV
• Flows for simultaneous manifold learning and density estimation
• Semi-Supervised Anomaly Detection - Towards Model-Independent Searches of New Physics
• GAPNet: Graph Attention based Point Neural Network for Exploiting Local Feature of Point Cloud
• Unsupervised in-distribution anomaly detection of new physics through conditional density estimation
• The motivation and status of two-body resonance decays after the LHC Run 2 and beyond
• Towards recognizing the light facet of the Higgs Boson
• Sliced Iterative Normalizing Flows

Cited by in corpus (21)

• Mining for Gluon Saturation at Colliders
• Tag N' Train: A Technique to Train Improved Classifiers on Unlabeled Data
• Bump Hunting in Latent Space
• Rare and Different: Anomaly Scores from a combination of likelihood and out-of-distribution models to detect new physics at the LHC
• Challenges for Unsupervised Anomaly Detection in Particle Physics
• Quasi Anomalous Knowledge: Searching for new physics with embedded knowledge
• Online-compatible Unsupervised Non-resonant Anomaly Detection
• Comparing Weak- and Unsupervised Methods for Resonant Anomaly Detection
• Deep Set Auto Encoders for Anomaly Detection in Particle Physics
• Unsupervised Hadronic SUEP at the LHC
• Anomalous Jet Identification via Sequence Modeling
• Shared Data and Algorithms for Deep Learning in Fundamental Physics
• Which Metric on the Space of Collider Events?
• Towards a method to anticipate dark matter signals with deep learning at the LHC
• New Methods and Datasets for Group Anomaly Detection From Fundamental Physics
• Search for anomalous quartic gauge couplings in the process ${\mu }^{+}{\mu }^{-}\to \bar{\nu }\nu \gamma \gamma$ with a nested local outlier factor
• Comment on "Reproducibility and Replication of Experimental Particle Physics Results"
• One-loop corrections to ALP couplings
• One-loop corrections to ALP couplings
• Preserving New Physics while Simultaneously Unfolding All Observables
• A FAIR and AI-ready Higgs boson decay dataset