Profile Likelihoods in Cosmology: When, Why and How illustrated with $\Lambda$CDM, Massive Neutrinos and Dark Energy

Abstract

Frequentist parameter inference using profile likelihoods has received increased attention in the cosmology literature recently since it can give important complementary information to Bayesian credible intervals. Here, we give a pedagogical review of frequentist parameter inference in cosmology and focus on when the graphical profile likelihood construction gives meaningful constraints, i.e. confidence intervals with correct coverage. This construction rests on the assumption of the asymptotic limit of a large data set such as in Wilks' theorem. We assess the validity of this assumption in the context of three cosmological models with Planck 2018 Plik_lite data: While our tests for the $\Lambda$CDM model indicate that the profile likelihood method gives correct coverage, $\Lambda$CDM with the sum of neutrino masses as a free parameter appears consistent with a Gaussian near a boundary motivating the use of the boundary-corrected or Feldman-Cousins graphical method; for $w_0$CDM with the equation of state of dark energy, $w_0$, as a free parameter, we find indication of a violation of the assumptions. Finally, we compare frequentist and Bayesian constraints of these models. Our results motivate care when using the graphical profile likelihood method in cosmology. Along with this paper, we publish our profile-likelihood code "pinc".

arXiv commentSmall changes to match the version published in PRD

References in corpus (68)

• First Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Determination of Cosmological Parameters
• Efficient Computation of CMB anisotropies in closed FRW models
• First Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Preliminary Maps and Basic Results
• Asymptotic formulae for likelihood-based tests of new physics
• A Unified Approach to the Classical Statistical Analysis of Small Signals
• The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: cosmological analysis of the DR12 galaxy sample
• The 6dF Galaxy Survey: Baryon Acoustic Oscillations and the Local Hubble Constant
• The Cosmic Linear Anisotropy Solving System (CLASS) II: Approximation schemes
• Stable clustering, the halo model and nonlinear cosmological power spectra
• The Clustering of the SDSS DR7 Main Galaxy Sample I: A 4 per cent Distance Measure at z=0.15
• The Completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: Cosmological Implications from two Decades of Spectroscopic Surveys at the Apache Point observatory
• Tensions between the Early and the Late Universe
• The fate of hints: updated global analysis of three-flavor neutrino oscillations
• Planck 2018 results. V. CMB power spectra and likelihoods
• DESI 2024 VI: Cosmological Constraints from the Measurements of Baryon Acoustic Oscillations
• The clustering of galaxies in the SDSS-III Baryon Oscillation Spectroscopic Survey: Baryon Acoustic Oscillations in the Data Release 9 Spectroscopic Galaxy Sample
• Conservative Constraints on Early Cosmology: an illustration of the Monte Python cosmological parameter inference code
• First Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Tests of Gaussianity
• CMB power spectrum parameter degeneracies in the era of precision cosmology
• The $H_0$ Olympics: A fair ranking of proposed models
• The clustering of the SDSS-IV extended Baryon Oscillation Spectroscopic Survey DR14 quasar sample: First measurement of Baryon Acoustic Oscillations between redshift 0.8 and 2.2
• Search for Invisible Decays of a Dark Photon Produced in e+e- Collisions at BaBar
• Background free search for neutrinoless double beta decay with GERDA Phase II
• The impact of priors and observables on parameter inferences in the Constrained MSSM
• Cosmological parameters derived from the final (PR4) Planck data release
• Dark Energy Survey Year 1 Results: Measurement of the Baryon Acoustic Oscillation scale in the distribution of galaxies to redshift 1
• COSMOPOWER: emulating cosmological power spectra for accelerated Bayesian inference from next-generation surveys
• Early dark energy is not excluded by current large-scale structure data
• II: Bayesian Methods for Cosmological Parameter Estimation from Cosmic Microwave Background Measurements
• Robust Neutrino Constraints by Combining Low Redshift Observations with the CMB
• New constraint on Early Dark Energy from Planck and BOSS data using the profile likelihood
• Converting non-relativistic dark matter to radiation
• Neutrino masses and their ordering: Global Data, Priors and Models
• Restoring cosmological concordance with early dark energy and massive neutrinos?
• Observational bounds on the cosmic radiation density
• Cosmology with the EFTofLSS and BOSS: dark energy constraints and a note on priors
• The Constrained NMSSM with a 126 GeV Higgs boson: A global analysis
• Fast cosmological parameter estimation using neural networks
• A fast test to assess the impact of marginalization in Monte Carlo analyses, and its application to cosmology
• Resolving the Hubble tension with Early Dark Energy
• Results from the Wilkinson Microwave Anisotropy Probe
• Cosmological constraints on the neutrino mass including systematic uncertainties
• Strong Bayesian Evidence for the Normal Neutrino Hierarchy
• New constraint on the tensor-to-scalar ratio from the $Planck$ and BICEP/Keck Array data using the profile likelihood
• Evidence for extra radiation? Profile likelihood versus Bayesian posterior
• CONNECT: A neural network based framework for emulating cosmological observables and cosmological parameter inference
• Stochastic optimization methods for extracting cosmological parameters from CMBR power spectra
• Cosmology with 6 parameters in the Stage-IV era: efficient marginalisation over nuisance parameters
• Beyond $\Lambda$CDM constraints from the full shape clustering measurements from BOSS and eBOSS
• Improved constraint on the primordial gravitational-wave density using recent cosmological data and its impact on cosmic string models
• CosmicNet II: Emulating extended cosmologies with efficient and accurate neural networks
• Modified gravity and massive neutrinos: constraints from the full shape analysis of BOSS galaxies and forecasts for Stage IV surveys
• BAO from angular clustering: optimization and mitigation of theoretical systematics
• Relieving tensions related to the lensing of CMB temperature power spectra
• Profiling Cold New Early Dark Energy
• Quantifying the tension between cosmological and terrestrial constraints on neutrino masses
• Cosmological constraints on early dark energy from the full shape analysis of eBOSS DR16
• LiteBIRD Science Goals and Forecasts. A Case Study of the Origin of Primordial Gravitational Waves using Large-Scale CMB Polarization
• Analysis of Unified Galaxy Power Spectrum Multipole Measurements
• Generalised model-independent characterisation of strong gravitational lenses V: reconstructing the lensing distance ratio by supernovae for a general Friedmann universe
• Prospects for Dark Energy Evolution: a Frequentist Multi-Probe Approach
• Hints of Neutrino Dark Matter scattering in the CMB? Constraints from the Marginalized and Profile Distributions
• Bayesian methods for fitting Baryon Acoustic Oscillations in the Lyman-$\alpha$ forest
• How accurately can we measure the baryon acoustic oscillation feature?
• Robust constraints on tensor perturbations from cosmological data: a comparative analysis from Bayesian and frequentist perspectives
• Bayes and Frequentism: a Particle Physicist's perspective
• Lower tensor-to-scalar ratio as possible signature of modified gravity
• Comparison of results on $N_{\mathrm{eff}}$ from various Planck likelihoods

Cited by in corpus (12)

• The CosmoVerse White Paper: Addressing observational tensions in cosmology with systematics and fundamental physics
• Revisiting the impact of neutrino mass hierarchies on neutrino mass constraints in light of recent DESI data
• Bayesian and frequentist perspectives agree on dynamical dark energy
• New Interpretations of the Cosmological Preference for a Negative Neutrino Mass
• A solution to the S8 tension through neutrino-dark matter interactions
• Determination of Hubble constant from Megamaser Cosmology Project using Profile Likelihood
• Constraints on Lorentz Invariance Violation from Gamma-ray Burst rest-frame spectral lags using Profile Likelihood
• Cosmological Constraints on Neutrino Masses in a Second-Order CPL Dark Energy Model
• An independent search for Jovian neutrinos using BOREXINO data
• Revisiting wideband pulsar timing measurements
• Determination of neutron star radius from pulse profile modeling using profile likelihood
• The BAO scale -- how standard is the standard ruler?