Statistical coverage for supersymmetric parameter estimation: a case study with direct detection of dark matter

Abstract

Models of weak-scale supersymmetry offer viable dark matter (DM) candidates. Their parameter spaces are however rather large and complex, such that pinning down the actual parameter values from experimental data can depend strongly on the employed statistical framework and scanning algorithm. In frequentist parameter estimation, a central requirement for properly constructed confidence intervals is that they cover true parameter values, preferably at exactly the stated confidence level when experiments are repeated infinitely many times. Since most widely-used scanning techniques are optimised for Bayesian statistics, one needs to assess their abilities in providing correct confidence intervals in terms of the statistical coverage. Here we investigate this for the Constrained Minimal Supersymmetric Standard Model (CMSSM) when only constrained by data from direct searches for dark matter. We construct confidence intervals from one-dimensional profile likelihoods and study the coverage by generating several pseudo-experiments for a few benchmark sets of pseudo-true parameters. We use nested sampling to scan the parameter space and evaluate the coverage for the benchmarks when either flat or logarithmic priors are imposed on gaugino and scalar mass parameters. The sampling algorithm has been used in the configuration usually adopted for exploration of the Bayesian posterior. We observe both under- and over-coverage, which in some cases vary quite dramatically when benchmarks or priors are modified. We show how most of the variation can be explained as the impact of explicit priors as well as sampling effects, where the latter are indirectly imposed by physicality conditions. For comparison, we also evaluate the coverage for Bayesian credible intervals, and observe significant under-coverage in those cases.

30 pages, 5 figures; v2 includes major updates in response to referee's comments; extra scans and tables added, discussion expanded, typos corrected; matches published version

References in corpus (38)

• Five-Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Cosmological Interpretation
• Particle Dark Matter: Evidence, Candidates and Constraints
• Type Ia Supernova Discoveries at z>1 From the Hubble Space Telescope: Evidence for Past Deceleration and Constraints on Dark Energy Evolution
• Supersymmetric Dark Matter
• A Unified Approach to the Classical Statistical Analysis of Small Signals
• The Supernova Legacy Survey: Measurement of Omega_M, Omega_Lambda and w from the First Year Data Set
• The 2dF Galaxy Redshift Survey: Power-spectrum analysis of the final dataset and cosmological implications
• Bayes in the sky: Bayesian inference and model selection in cosmology
• Non-Baryonic Dark Matter - Observational Evidence and Detection Methods
• DarkSUSY: Computing Supersymmetric Dark Matter Properties Numerically
• SOFTSUSY: a program for calculating supersymmetric spectra
• First-year Sloan Digital Sky Survey-II (SDSS-II) Supernova Results: Hubble Diagram and Cosmological Parameters
• Limits and Confidence Intervals in the Presence of Nuisance Parameters
• Study of Constrained Minimal Supersymmetry
• Primordial Nucleosynthesis: from precision cosmology to fundamental physics
• Dark matter maps reveal cosmic scaffolding
• Applications of Bayesian model selection to cosmological parameters
• Improved predictions for g-2 of the muon and α_{\rm QED}(M_Z^2)
• A Markov Chain Monte Carlo Analysis of the CMSSM
• The impact of priors and observables on parameter inferences in the Constrained MSSM
• Dark Matter Candidates
• Design and Performance of the XENON10 Dark Matter Experiment
• Constraints on inelastic dark matter from XENON10
• Likelihood Functions for Supersymmetric Observables in Frequentist Analyses of the CMSSM and NUHM1
• Implications for the Constrained MSSM from a new prediction for b to s gamma
• XENON10/100 dark matter constraints in comparison with CoGeNT and DAMA: examining the Leff dependence
• Natural Priors, CMSSM Fits and LHC Weather Forecasts
• A Profile Likelihood Analysis of the Constrained MSSM with Genetic Algorithms
• Direct Constraints on Minimal Supersymmetry from Fermi-LAT Observations of the Dwarf Galaxy Segue 1
• Challenges of Profile Likelihood Evaluation in Multi-Dimensional SUSY Scans
• Reconstructing WIMP Properties in Direct Detection Experiments Including Galactic Dark Matter Distribution Uncertainties
• Identification of Dark Matter particles with LHC and direct detection data
• Implications of Initial LHC Searches for Supersymmetry
• Frequentist Analysis of the Parameter Space of Minimal Supergravity
• Statistical methods for cosmological parameter selection and estimation
• How well will ton-scale dark matter direct detection experiments constrain minimal supersymmetry?
• A coherent understanding of low-energy nuclear recoils in liquid xenon
• Efficient reconstruction of CMSSM parameters from LHC data - A case study

Cited by in corpus (23)

• Beyond $\Lambda$CDM: Problems, solutions, and the road ahead
• The landscape, the swampland and the era of precision cosmology
• Accelerated expansion from ghost-free bigravity: a statistical analysis with improved generality
• GAMBIT: The Global and Modular Beyond-the-Standard-Model Inference Tool
• Observational constraints on viable f(R) parametrizations with geometrical and dynamical probes
• Combined collider constraints on neutralinos and charginos
• Dark matter and collider signatures of the MSSM
• Global fits of the dark matter-nucleon effective interactions
• Comparison of statistical sampling methods with ScannerBit, the GAMBIT scanning module
• Pippi - painless parsing, post-processing and plotting of posterior and likelihood samples
• Fundamental statistical limitations of future dark matter direct detection experiments
• Prospects for direct detection of dark matter in an effective theory approach
• Use of event-level neutrino telescope data in global fits for theories of new physics
• Global fit of pseudo-Nambu-Goldstone Dark Matter
• What can(not) be measured with ton-scale dark matter direct detection experiments
• A comparison of optimisation algorithms for high-dimensional particle and astrophysics applications
• Naturalness of the relaxion mechanism
• Simple and statistically sound recommendations for analysing physical theories
• Bayesian analysis and naturalness of (Next-to-)Minimal Supersymmetric Models
• Bayesian Reconstruction of the Velocity Distribution of Weakly Interacting Massive Particles from Direct Dark Matter Detection Data
• Exploring the 2HDM with Global Fits in $\text{GAMBIT}$
• Minimal 4D Composite Higgs Models Under Current LHC Constraints
• Effects of Threshold Energy on Reconstructions of Properties of Low-Mass WIMPs in Direct Dark Matter Detection Experiments