A method for approximating optimal statistical significances with machine-learned likelihoods

Abstract

Machine-learning techniques have become fundamental in high-energy physics and, for new physics searches, it is crucial to know their performance in terms of experimental sensitivity, understood as the statistical significance of the signal-plus-background hypothesis over the background-only one. We present here a simple method that combines the power of current machine-learning techniques to face high-dimensional data with the likelihood-based inference tests used in traditional analyses, which allows us to estimate the sensitivity for both discovery and exclusion limits through a single parameter of interest, the signal strength. Based on supervised learning techniques, it can perform well also with high-dimensional data, when traditional techniques cannot. We apply the method to a toy model first, so we can explore its potential, and then to a LHC study of new physics particles in dijet final states. Considering as the optimal statistical significance the one we would obtain if the true generative functions were known, we show that our method provides a better approximation than the usual naive counting experimental results.

arXiv comment24 pages, 8 figures; matches version published in Eur. Phys. J. C

References in corpus (25)

• XGBoost: A Scalable Tree Boosting System
• Asymptotic formulae for likelihood-based tests of new physics
• Machine learning and the physical sciences
• Searching for Exotic Particles in High-Energy Physics with Deep Learning
• Identifying Boosted Objects with N-subjettiness
• Deep Learning and its Application to LHC Physics
• Maximizing Boosted Top Identification by Minimizing N-subjettiness
• Jet Substructure at the Large Hadron Collider: A Review of Recent Advances in Theory and Machine Learning
• Classification without labels: Learning from mixed samples in high energy physics
• Learning New Physics from a Machine
• Constraining Effective Field Theories with Machine Learning
• A Guide to Constraining Effective Field Theories with Machine Learning
• Machine and Deep Learning Applications in Particle Physics
• A guide for deploying Deep Learning in LHC searches: How to achieve optimality and account for uncertainty
• Uncertainty Aware Learning for High Energy Physics
• Publishing statistical models: Getting the most out of particle physics experiments
• Online-compatible Unsupervised Non-resonant Anomaly Detection
• E Pluribus Unum Ex Machina: Learning from Many Collider Events at Once
• Parametrized classifiers for optimal EFT sensitivity
• The DNNLikelihood: enhancing likelihood distribution with Deep Learning
• Anomaly detection from mass unspecific jet tagging
• Using Machine Learning to disentangle LHC signatures of Dark Matter candidates
• Parameter Inference from Event Ensembles and the Top-Quark Mass
• Towards a method to anticipate dark matter signals with deep learning at the LHC
• Distinguishing $W^{\prime }$ Signals at Hadron Colliders Using Neural Networks

Cited by in corpus (8)

• Unbinned multivariate observables for global SMEFT analyses from machine learning
• Improving sensitivity of trilinear RPV SUSY searches using machine learning at the LHC
• Insights into Dark Matter Direct Detection Experiments: Decision Trees versus Deep Learning
• Riemannian Data preprocessing in Machine Learning to focus on QCD color structure
• Machine-Learning Analysis of Radiative Decays to Dark Matter at the LHC
• BitHEP -- The Limits of Low-Precision ML in HEP
• Shedding Light on Dark Matter at the LHC with Machine Learning
• AI-assisted design of experiments at the frontiers of computation: methods and new perspectives