A new goodness-of-fit statistic and its application to 21-cm cosmology

Abstract

The reduced chi-squared statistic is a commonly used goodness-of-fit measure, but it cannot easily detect features near the noise level, even when a large amount of data is available. In this paper, we introduce a new goodness-of-fit measure that we name the reduced psi-squared statistic. It probes the two-point correlations in the residuals of a fit, whereas chi-squared accounts for only the absolute values of each residual point, not considering the relationship between these points. The new statistic maintains sensitivity to individual outliers, but is superior to chi-squared in detecting wide, low level features in the presence of a large number of noisy data points. After presenting this new statistic, we show an instance of its use in the context of analyzing radio spectroscopic data for 21-cm cosmology experiments. We perform fits to simulated data with four components: foreground emission, the global 21-cm signal, an idealized instrument systematic, and noise. This example is particularly timely given the ongoing efforts to confirm the first observational result for this signal, where this work found its original motivation. In addition, we release a Python script dubbed $\text{psipy}$ which allows for quick, efficient calculation of the reduced psi-squared statistic on arbitrary data arrays, to be applied in any field of study.

arXiv comment22 pages, 10 figures, submitted to JCAP, psipy code to calculate new statistic available at https://bitbucket.org/ktausch/psipy

References in corpus (15)

• Global Optimization by Basin-Hopping and the Lowest Energy Structures of Lennard-Jones Clusters Containing up to 110 Atoms
• An absorption profile centred at 78 megahertz in the sky-averaged spectrum
• Possible interaction between baryons and dark-matter particles revealed by the first stars
• Modeling the Radio Background from the First Black Holes at Cosmic Dawn: Implications for the 21 cm Absorption Amplitude
• Charting the Parameter Space of the Global 21-cm Signal
• Design and characterization of the Large-Aperture Experiment to Detect the Dark Age (LEDA) radiometer systems
• Tighter Limits on Dark Matter Explanations of the Anomalous EDGES 21cm Signal
• Probing the Dark Ages at Z~20: The SCI-HI 21 cm All-Sky Spectrum Experiment
• The EDGES 21 cm Anomaly and Properties of Dark Matter
• Results from EDGES High-Band: I. Constraints on Phenomenological Models for the Global $21$ cm Signal
• SARAS 2 constraints on global 21-cm signals from the Epoch of Reionization
• A Space-Based Observational Strategy for Characterizing the First Stars and Galaxies Using the Redshifted 21-cm Global Spectrum
• Results from EDGES High-Band: II. Constraints on Parameters of Early Galaxies
• Global 21-cm signal extraction from foreground and instrumental effects I: Pattern recognition framework for separation using training sets
• Parametrizations of the global 21-cm signal and parameter estimation from single-dipole experiments

Cited by in corpus (16)

• Data Analysis for Precision 21 cm Cosmology
• Reviving Millicharged Dark Matter for 21-cm Cosmology
• A Ground Plane Artifact that Induces an Absorption Profile in Averaged Spectra from Global 21-cm Measurements - with Possible Application to EDGES
• Spectral Index of the Diffuse Radio Background Between 50 and 100 MHz
• Observational Constraints and Cosmological Implications of Scalar-Tensor $f(R,T)$ Gravity
• Assessment of the Projection-induced Polarimetry Technique for Constraining the Foreground Spectrum in Global 21 cm Cosmology
• Lunar Orbit Measurement of Cosmic Dawn 21 cm Global Spectrum
• Imaging sensitivity of a linear interferometer array on lunar orbit
• Transit cosmological models in Myrzakulov F(R,T) gravity theory
• Diagnostic and Comparative Analysis of Dark Energy Models with $q(z)$ Parametrizations
• Extracting the Global 21-cm signal from Cosmic Dawn and Epoch of Reionization in the presence of Foreground and Ionosphere
• Ensuring Robustness in Training Set Based Global 21-cm Cosmology Analysis
• Forecast measurement of the 21 cm global spectrum from Lunar orbit with the Vari-Zeroth-Order Polynomial (VZOP) method
• Astrophysical uncertainties challenge 21-cm forecasts: A primordial black hole case study
• Geometric formulation of $k$-essence and late-time acceleration
• Optimizing Foreground Modelling for Global 21cm Cosmology with GPU-Accelerated Nested Sampling