Bayesian cross validation for gravitational-wave searches in pulsar-timing array data

Abstract

Gravitational-wave data analysis demands sophisticated statistical noise models in a bid to extract highly obscured signals from data. In Bayesian model comparison, we choose among a landscape of models by comparing their marginal likelihoods. However, this computation is numerically fraught and can be sensitive to arbitrary choices in the specification of parameter priors. In Bayesian cross validation, we characterize the fit and predictive power of a model by computing the Bayesian posterior of its parameters in a training dataset, and then use that posterior to compute the averaged likelihood of a different testing dataset. The resulting cross-validation scores are straightforward to compute; they are insensitive to prior tuning; and they penalize unnecessarily complex models that overfit the training data at the expense of predictive performance. In this article, we discuss cross validation in the context of pulsar-timing-array data analysis, and we exemplify its application to simulated pulsar data (where it successfully selects the correct spectral index of a stochastic gravitational-wave background), and to a pulsar dataset from the NANOGrav 11-year release (where it convincingly favors a model that represents a transient feature in the interstellar medium). We argue that cross validation offers a promising alternative to Bayesian model comparison, and we discuss its use for gravitational-wave detection, by selecting or refuting models that include a gravitational-wave component.

arXiv comment7 pages, 4 figures. Submitted to MNRAS

References in corpus (20)

• Bayes in the sky: Bayesian inference and model selection in cosmology
• The NANOGrav 11-year Data Set: High-precision timing of 45 Millisecond Pulsars
• The North American Nanohertz Observatory for Gravitational Waves
• The promise of multi-band gravitational wave astronomy
• The NANOGrav 11-year Data Set: Pulsar-timing Constraints On The Stochastic Gravitational-wave Background
• From Spin Noise to Systematics: Stochastic Processes in the First International Pulsar Timing Array Data Release
• New advances in the Gaussian-process approach to pulsar-timing data analysis
• All correlations must die: Assessing the significance of a stochastic gravitational-wave background in pulsar-timing arrays
• Constraining the Solution to the Last Parsec Problem with Pulsar Timing
• Towards Robust Gravitational Wave Detection with Pulsar Timing Arrays
• A Second Chromatic Timing Event of Interstellar Origin toward PSR J1713+0747
• Systematic and Stochastic Variations in Pulsar Dispersion Measures
• A Measurement Model for Precision Pulsar Timing
• Testing general relativity with gravitational waves: a reality check
• Accelerated Bayesian model-selection and parameter-estimation in continuous gravitational-wave searches with pulsar-timing arrays
• Gravitational-Wave Detection and Astrophysics with Pulsar Timing Arrays
• Effects of the ISM on Detection of Low-frequency Gravitational Waves
• Pulsar timing noise and the minimum observation time to detect gravitational waves with pulsar timing arrays
• Weighing The Evidence For A Gravitational-Wave Background In The First International Pulsar Timing Array Data Challenge
• The Second International Pulsar Timing Array Mock Data Challenge

Cited by in corpus (4)

• The NANOGrav 12.5-year Data Set: Search For An Isotropic Stochastic Gravitational-Wave Background
• The NANOGrav 11-Year Data Set: Evolution of Gravitational Wave Background Statistics
• Posterior predictive checking for gravitational-wave detection with pulsar timing arrays: II. Posterior predictive distributions and pseudo Bayes factors
• A Parallelized Bayesian Approach To Accelerated Gravitational-Wave Background Characterization