Statistical Models with Uncertain Error Parameters

Abstract

In a statistical analysis in Particle Physics, nuisance parameters can be introduced to take into account various types of systematic uncertainties. The best estimate of such a parameter is often modeled as a Gaussian distributed variable with a given standard deviation (the corresponding "systematic error"). Although the assigned systematic errors are usually treated as constants, in general they are themselves uncertain. A type of model is presented where the uncertainty in the assigned systematic errors is taken into account. Estimates of the systematic variances are modeled as gamma distributed random variables. The resulting confidence intervals show interesting and useful properties. For example, when averaging measurements to estimate their mean, the size of the confidence interval increases for decreasing goodness-of-fit, and averages have reduced sensitivity to outliers. The basic properties of the model are presented and several examples relevant for Particle Physics are explored.

arXiv comment26 pages, 27 figures

References in corpus (3)

• Asymptotic formulae for likelihood-based tests of new physics
• On the combination of correlated estimates of a physics observable
• Statistical Challenges for Searches for New Physics at the LHC

Cited by in corpus (14)

• Semitauonic $b$-hadron decays: A lepton flavor universality laboratory
• Publishing statistical models: Getting the most out of particle physics experiments
• Novel approaches in Hadron Spectroscopy
• The W boson mass weighs in on the non-standard Higgs
• MFV approach to robust estimate of neutron lifetime
• A meta-analysis of neutron lifetime measurements
• Alternative to the application of PDG scale factors
• Effect of Systematic Uncertainty Estimation on the Muon $g-2$ Anomaly
• A generalized statistical model for fits to parton distributions
• Higher-order asymptotic corrections and their application to the Gamma Variance Model
• Under-coverage in high-statistics counting experiments with finite MC samples
• Diffusion of Cosmic Antiprotons Generated throughout the Dark Matter Halo -- A Semi-Analytical Solution for a Linear Galactic Wind Model
• A Robust Bayesian Meta-Analysis for Estimating the Hubble Constant via Time Delay Cosmography
• Parton distribution functions and strong coupling constant: MSHT