A method for approximating optimal statistical significances with machine-learned likelihoods

Abstract

Machine-learning techniques have become fundamental in high-energy physics and, for new physics searches, it is crucial to know their performance in terms of experimental sensitivity, understood as the statistical significance of the signal-plus-background hypothesis over the background-only one. We present here a simple method that combines the power of current machine-learning techniques to face high-dimensional data with the likelihood-based inference tests used in traditional analyses, which allows us to estimate the sensitivity for both discovery and exclusion limits through a single parameter of interest, the signal strength. Based on supervised learning techniques, it can perform well also with high-dimensional data, when traditional techniques cannot. We apply the method to a toy model first, so we can explore its potential, and then to a LHC study of new physics particles in dijet final states. Considering as the optimal statistical significance the one we would obtain if the true generative functions were known, we show that our method provides a better approximation than the usual naive counting experimental results.

24 pages, 8 figures; matches version published in Eur. Phys. J. C

References in corpus (2)

• Classification without labels: Learning from mixed samples in high energy physics
• Uncertainty Aware Learning for High Energy Physics

Cited by in corpus (8)

• Unbinned multivariate observables for global SMEFT analyses from machine learning
• Improving sensitivity of trilinear RPV SUSY searches using machine learning at the LHC
• Insights into Dark Matter Direct Detection Experiments: Decision Trees versus Deep Learning
• Riemannian Data preprocessing in Machine Learning to focus on QCD color structure
• Machine-Learning Analysis of Radiative Decays to Dark Matter at the LHC
• BitHEP -- The Limits of Low-Precision ML in HEP
• Shedding Light on Dark Matter at the LHC with Machine Learning
• AI-assisted design of experiments at the frontiers of computation: methods and new perspectives