Higher-order asymptotic corrections and their application to the Gamma Variance Model

Abstract

We present improved methods for calculating confidence intervals and $p$-values in situations where standard asymptotic approaches fail due to small sample sizes. We apply these techniques to a specific class of statistical model that can incorporate uncertainties in parameters that themselves represent uncertainties (informally, "errors on errors") called the Gamma Variance Model. This model contains fixed parameters, generically called $\epsilon$, that represent the relative uncertainties in estimates of standard deviations of Gaussian distributed measurements. If the $\epsilon$ parameters are small, one can construct confidence intervals and $p$-values using standard asymptotic methods. This is formally similar to the familiar situation of a large data sample, in which estimators for all adjustable parameters have Gaussian distributions. Here we address the important case where the $\epsilon$ parameters are not small and as a consequence the asymptotic distributions do not represent a good approximation. We investigate improved test statistics based on the technology of higher-order asymptotics ($p^{\ast }$ approximation and Bartlett correction).

arXiv comment19 pages, 8 figures

References in corpus (7)

• Asymptotic formulae for likelihood-based tests of new physics
• Searching for new physics with profile likelihoods: Wilks and beyond
• Statistical Models with Uncertain Error Parameters
• Statistical Challenges for Searches for New Physics at the LHC
• Alternative to the application of PDG scale factors
• The Banff Challenge: Statistical Detection of a Noisy Signal
• Effect of Systematic Uncertainty Estimation on the Muon $g-2$ Anomaly

Cited by in corpus (1)

• Improved Asymptotic Formulae for Statistical Interpretation Based on Likelihood Ratio Tests