Use Model Averaging instead of Model Selection in Pulsar Timing

Abstract

Over the past decade and a half, adoption of Bayesian inference in pulsar timing analysis has led to increasingly sophisticated models. The recent announcement of evidence for a stochastic background of gravitational waves by various pulsar timing array projects highlighted Bayesian inference as a central tool for parameter estimation and model selection. Despite its success, Bayesian inference is occasionally misused in the pulsar timing community. A common workflow is that the data is analyzed in multiple steps: a first analysis of single pulsars individually, and a subsequent analysis of the whole array of pulsars. A mistake that is then sometimes introduced stems from using the posterior distribution to craft the prior for the analysis of the same data in a second step, a practice referred to in the statistics literature as ``circular analysis.'' This is done to prune the model for computational efficiency. Multiple recent high-profile searches for gravitational waves by pulsar timing array (PTA) projects have this workflow. This letter highlights this error and suggests that Spike and Slab priors can be used to carry out model averaging instead of model selection in a single pass. Spike and Slab priors are proved to be equal to Log-Uniform priors.

6 pages, 2 figures

References in corpus (7)

• BayesWave: Bayesian Inference for Gravitational Wave Bursts and Instrument Glitches
• On measuring the gravitational-wave background using Pulsar Timing Arrays
• New advances in the Gaussian-process approach to pulsar-timing data analysis
• Identifying and mitigating noise sources in precision pulsar timing data sets
• Time-domain Implementation of the Optimal Cross-Correlation Statistic for Stochastic Gravitational-Wave Background Searches in Pulsar Timing Data
• Accelerating pulsar timing data analysis
• Pulsar Timing Arrays require hierarchical models

Cited by in corpus (6)

• Ensemble noise properties of the European Pulsar Timing Array
• Choosing suitable noise models for nanohertz gravitational-wave astrophysics
• Reading signatures of supermassive binary black holes in pulsar timing array observations
• Rapid Construction of Joint Pulsar Timing Array Datasets: The Lite Method
• The NANOGrav 15 yr Data Set: Customized Chromatic Noise Models
• On the calculation of p-values for quadratic statistics in Pulsar Timing Arrays