Ensuring Robustness in Training Set Based Global 21-cm Cosmology Analysis

Abstract

We present a methodology for ensuring the robustness of our analysis pipeline in separating the global 21-cm hydrogen cosmology signal from large systematics based on singular value decomposition (SVD) of training sets. We show how traditional goodness-of-fit metrics such as the ${\chi }^2$ statistic that assess the fit to the full data may not be able to detect a suboptimal extraction of the 21-cm signal when it is fit alongside one or more additional components due to significant covariance between them. However, we find that comparing the number of SVD eigenmodes for each component chosen by the pipeline for a given fit to the distribution of eigenmodes chosen for synthetic data realizations created from training set curves can detect when one or more of the training sets is insufficient to optimally extract the signal. Furthermore, this test can distinguish which training set (e.g. foreground, 21-cm signal) needs to be modified in order to better describe the data and improve the quality of the 21-cm signal extraction. We also extend this goodness-of-fit testing to cases where a prior distribution derived from the training sets is applied and find that, in this case, the ${\chi }^2$ statistic as well as the recently introduced ${\psi }^2$ statistic are able to detect inadequacies in the training sets due to the increased restrictions imposed by the prior. Crucially, the tests described in this paper can be performed when analyzing any type of observations with our pipeline.

16 pages, 6 figures, 2 tables. Submitted to the Astrophysical Journal

References in corpus (8)

• Cosmology at Low Frequencies: The 21 cm Transition and the High-Redshift Universe
• Signature of Excess Radio Background in the 21-cm Global Signal and Power Spectrum
• Testing for calibration systematics in the EDGES low-band data using Bayesian model selection
• Decoding the X-ray Properties of Pre-Reionization Era Sources
• The Effects of Population III X-ray and Radio Backgrounds on the Cosmological 21-cm Signal
• Formulating and critically examining the assumptions of global 21-cm signal analyses: How to avoid the false troughs that can appear in single spectrum fits
• Global 21-cm signal extraction from foreground and instrumental effects III: Utilizing drift-scan time dependence and full Stokes measurements
• Modelling the Galactic Foreground and Beam Chromaticity for Global 21-cm Cosmology