Global 21-cm signal extraction from foreground and instrumental effects I: Pattern recognition framework for separation using training sets

Abstract

The sky-averaged (global) highly redshifted 21-cm spectrum from neutral hydrogen is expected to appear in the VHF range of $\sim 20-200$ MHz and its spectral shape and strength are determined by the heating properties of the first stars and black holes, by the nature and duration of reionization, and by the presence or absence of exotic physics. Measurements of the global signal would therefore provide us with a wealth of astrophysical and cosmological knowledge. However, the signal has not yet been detected because it must be seen through strong foregrounds weighted by a large beam, instrumental calibration errors, and ionospheric, ground and radio-frequency-interference effects, which we collectively refer to as "systematics". Here, we present a signal extraction method for global signal experiments which uses Singular Value Decomposition (SVD) of "training sets" to produce systematics basis functions specifically suited to each observation. Instead of requiring precise absolute knowledge of the systematics, our method effectively requires precise knowledge of how the systematics can vary. After calculating eigenmodes for the signal and systematics, we perform a weighted least square fit of the corresponding coefficients and select the number of modes to include by minimizing an information criterion. We compare the performance of the signal extraction when minimizing various information criteria and find that minimizing the Deviance Information Criterion (DIC) most consistently yields unbiased fits. The methods used here are built into our widely applicable, publicly available Python package, $\text{pylinex}$, which analytically calculates constraints on signals and systematics from given data, errors, and training sets.

10 pages, 7 figures, submitted to ApJ, code available at https://bitbucket.org/ktausch/pylinex

References in corpus (14)

• Cosmology at Low Frequencies: The 21 cm Transition and the High-Redshift Universe
• The Global 21-cm Signal in the Context of the High-z Galaxy Luminosity Function
• All-sky Galactic radiation at 45 MHz and spectral index between 45 and 408 MHz
• BIGHORNS - Broadband Instrument for Global HydrOgen ReioNisation Signal
• Luminosity and redshift dependent quasar clustering
• First results on the Epoch of Reionization from First Light with SARAS 2
• Results from EDGES High-Band: I. Constraints on Phenomenological Models for the Global $21$ cm Signal
• Emulating Simulations of Cosmic Dawn for 21cm Power Spectrum Constraints on Cosmology, Reionization, and X-ray Heating
• Foreground Model and Antenna Calibration Errors in the Measurement of the Sky-Averaged λ21 cm Signal at z~20
• Emulation of reionization simulations for Bayesian inference of astrophysics parameters using neural networks
• Multi-redshift limits on the 21cm power spectrum from PAPER
• Exploiting the full potential of photometric quasar surveys: Optimal power spectra through blind mitigation of systematics
• A Space-Based Observational Strategy for Characterizing the First Stars and Galaxies Using the Redshifted 21-cm Global Spectrum
• Erasing the variable: Empirical foreground discovery for global 21 cm spectrum experiments

Cited by in corpus (33)

• Data Analysis for Precision 21 cm Cosmology
• A Ground Plane Artifact that Induces an Absorption Profile in Averaged Spectra from Global 21-cm Measurements - with Possible Application to EDGES
• The REACH radiometer for detecting the 21-cm hydrogen signal from redshift 7.5 to 28
• Mitigating Internal Instrument Coupling for 21 cm Cosmology I: Temporal and Spectral Modeling in Simulations
• Spectral Index of the Diffuse Radio Background Between 50 and 100 MHz
• Transformative Science from the Lunar Farside: Observations of the Dark Ages and Exoplanetary Systems at Low Radio Frequencies
• Gaussian Process Foreground Subtraction and Power Spectrum Estimation for 21 cm Cosmology
• Results from EDGES High-Band: II. Constraints on Parameters of Early Galaxies
• Formulating and critically examining the assumptions of global 21-cm signal analyses: How to avoid the false troughs that can appear in single spectrum fits
• Global 21-cm Signal Extraction from Foreground and Instrumental Effects II: Efficient and Self-Consistent Technique for Constraining Nonlinear Signal Models
• Assessment of the Projection-induced Polarimetry Technique for Constraining the Foreground Spectrum in Global 21 cm Cosmology
• Use of Time Dependent Data in Bayesian Global 21cm Foreground and Signal Modelling
• Lunar Orbit Measurement of Cosmic Dawn 21 cm Global Spectrum
• Global 21-cm signal extraction from foreground and instrumental effects III: Utilizing drift-scan time dependence and full Stokes measurements
• Lost Horizon: Quantifying the Effect of Local Topography on Global 21-cm Cosmology Data Analysis
• A new goodness-of-fit statistic and its application to 21-cm cosmology
• Global 21-cm signal extraction from foreground and instrumental effects IV: Accounting for realistic instrument uncertainties and their overlap with foreground and signal models
• Modelling the Galactic Foreground and Beam Chromaticity for Global 21-cm Cosmology
• Constraining Warm Dark Matter and Pop III stars with the Global 21-cm Signal
• Extracting the 21-cm Power Spectrum and the reionization parameters from mock datasets using Artificial Neural Networks
• A General Bayesian Framework to Account for Foreground Map Errors in Global 21-cm Experiments
• Sky-averaged 21-cm signal extraction using multiple antennas with an SVD framework: the REACH case
• Joint constraints on reionization: a framework for combining the global 21cm signal and the kinetic Sunyaev-Zel'dovich effect
• Simulation-Based Inference of the sky-averaged 21-cm signal from CD-EoR with REACH
• Ensuring Robustness in Training Set Based Global 21-cm Cosmology Analysis
• A Differentiable, End-to-End Forward Model for 21 cm Cosmology: Estimating the Foreground, Instrument, and Signal Joint Posterior
• A strong broadband 21 cm cosmological signal from dark matter spin-flip interactions
• A Bayesian approach to modelling spectrometer data chromaticity corrected using beam factors -- II. Model priors and posterior odds
• A general Bayesian model-validation framework based on null-test evidence ratios, with an example application to global 21-cm cosmology
• On the Possibility of Detecting a Global Signal in the Line of the Hyperfine Structure of Hydrogen from the Dark Ages
• Exploring Machine Learning Regression Models for Advancing Foreground Mitigation and Global 21cm Signal Parameter Extraction
• A Multi-Site Study of Radio Environment for Cosmology Experiments
• Optimizing Foreground Modelling for Global 21cm Cosmology with GPU-Accelerated Nested Sampling