On the calculation of p-values for quadratic statistics in Pulsar Timing Arrays

Abstract

Pulsar Timing Array (PTA) projects have reported various lines of evidence suggesting the presence of a stochastic gravitational wave (GW) background in their data. One key line of evidence involves a detection statistic sensitive to inter-pulsar correlations, such as those induced by GWs. A $p$-value is then calculated to assess how unlikely it is for the observed signal to arise under the null hypothesis $H_0$, purely by chance. However, PTAs cannot empirically draw samples from $H_0$. As a workaround, various techniques are used in the literature to approximate $p$-values under $H_0$. One such technique, which has been heralded as a model-independent method, is the use of "scrambling" transformations that modify the data to cancel out pulsar correlations, thereby simulating realizations from $H_0$. In this work, scrambling methods and the detection statistic are investigated from first principles. The $p$-value methodology that is discussed is general, but the discussions regarding a specific detection statistic apply to the detection of a stochastic background of gravitational waves with PTAs. All methods in the literature to calculate $p$-values for such a detection statistic are rigorously analyzed, and many analytical expressions are derived. All this leads to the conclusion that scrambling methods are not model-independent and thus not completely empirical. Rigorous Bayesian and Frequentist $p$-value calculation methods are advocated, the evaluation of which depend on the generalized ${\chi }^2$ distribution. This view is consistent with the posterior predictive $p$-value approach that is already in the literature. Efficient expressions are derived to evaluate the generalized ${\chi }^2$ distribution of the detection statistic on real data. It is highlighted that no Frequentist $p$-values have been calculated correctly in the PTA literature to date.

29 pages, 3 figures

References in corpus (27)

• Array Programming with NumPy
• The NANOGrav 15-year Data Set: Evidence for a Gravitational-Wave Background
• Search for an isotropic gravitational-wave background with the Parkes Pulsar Timing Array
• Searching for the nano-Hertz stochastic gravitational wave background with the Chinese Pulsar Timing Array Data Release I
• The second data release from the European Pulsar Timing Array III. Search for gravitational wave signals
• The NANOGrav 15-year Data Set: Search for Signals from New Physics
• The NANOGrav 15-year Data Set: Observations and Timing of 68 Millisecond Pulsars
• The second data release from the European Pulsar Timing Array I. The dataset and timing analysis
• Expected properties of the first gravitational wave signal detected with pulsar timing arrays
• The Parkes Pulsar Timing Array Third Data Release
• The NANOGrav 15-year Data Set: Bayesian Limits on Gravitational Waves from Individual Supermassive Black Hole Binaries
• New advances in the Gaussian-process approach to pulsar-timing data analysis
• Time-domain Implementation of the Optimal Cross-Correlation Statistic for Stochastic Gravitational-Wave Background Searches in Pulsar Timing Data
• The second data release from the European Pulsar Timing Array II. Customised pulsar noise models for spatially correlated gravitational waves
• The MeerKAT Pulsar Timing Array: The first search for gravitational waves with the MeerKAT radio telescope
• The second data release from the European Pulsar Timing Array V. Search for continuous gravitational wave signals
• Hellings and Downs correlation of an arbitrary set of pulsars
• Low-rank approximations for large stationary covariance matrices, as used in the Bayesian and generalized-least-squares analysis of pulsar-timing data
• The MeerKAT Pulsar Timing Array: The $4.5$-year data release and the noise and stochastic signals of the millisecond pulsar population
• The NANOGrav 15-year Gravitational-Wave Background Methods
• Pulsar Timing Arrays require hierarchical models
• Generalized optimal statistic for characterizing multiple correlated signals in pulsar timing arrays
• Spatial and Spectral Characterization of the Gravitational-wave Background with the PTA Optimal Statistic
• Posterior predictive checking for gravitational-wave detection with pulsar timing arrays: I. The optimal statistic
• Toward robust detections of nanohertz gravitational waves
• Use Model Averaging instead of Model Selection in Pulsar Timing
• The NANOGrav 15 yr data set: Posterior predictive checks for gravitational-wave detection with pulsar timing arrays