Monte Carlo method for constructing confidence intervals with unconstrained and constrained nuisance parameters in the NOvA experiment

Abstract

Measuring observables to constrain models using maximum-likelihood estimation is fundamental to many physics experiments. Wilks' theorem provides a simple way to construct confidence intervals on model parameters, but it only applies under certain conditions. These conditions, such as nested hypotheses and unbounded parameters, are often violated in neutrino oscillation measurements and other experimental scenarios. Monte Carlo methods can address these issues, albeit at increased computational cost. In the presence of nuisance parameters, however, the best way to implement a Monte Carlo method is ambiguous. This paper documents the method selected by the NOvA experiment, the profile construction. It presents the toy studies that informed the choice of method, details of its implementation, and tests performed to validate it. It also includes some practical considerations which may be of use to others choosing to use the profile construction.

28 pages, 14 figures

References in corpus (13)

• Asymptotic formulae for likelihood-based tests of new physics
• First measurement of neutrino oscillation parameters using neutrinos and antineutrinos by NOvA
• The NuMI Neutrino Beam
• First measurement of electron neutrino appearance in NOvA
• An Improved Measurement of Neutrino Oscillation Parameters by the NOvA Experiment
• New constraints on oscillation parameters from ${\nu }_e$ appearance and ${\nu }_{\mu }$ disappearance in the NOvA experiment
• Constraints on Oscillation Parameters from ${\nu }_e$ Appearance and ${\nu }_{\mu }$ Disappearance in NOvA
• Mass hierarchy discrimination with atmospheric neutrinos in large volume ice/water Cherenkov detectors
• On Bayesian Treatment of Systematic Uncertainties in Confidence Interval Calculation
• Gaussian Process Accelerated Feldman-Cousins Approach for Physical Parameter Inference
• Coverage Of Confidence Intervals For Poisson Statistics In Presence Of Systematic Uncertainties
• Combining Neutrino Oscillation Experiments with the Feldman-Cousins Method
• An importance sampling method for Feldman-Cousins confidence intervals

Cited by in corpus (3)

• Search for Extremely-High-Energy Neutrinos and First Constraints on the Ultrahigh-Energy Cosmic-Ray Proton Fraction with IceCube
• Precision measurement of neutrino oscillation parameters with 10 years of data from the NOvA experiment
• Under-coverage in high-statistics counting experiments with finite MC samples