Gaussian Process Foreground Subtraction and Power Spectrum Estimation for 21 cm Cosmology

Abstract

One of the primary challenges in enabling the scientific potential of 21 cm intensity mapping at the Epoch of Reionization (EoR) is the separation of astrophysical foreground contamination. Recent works have claimed that Gaussian process regression (GPR) can robustly perform this separation, particularly at low Fourier $k$ wavenumbers where the signal reaches its peak signal-to-noise ratio. We revisit this topic by casting GPR foreground subtraction (GPR-FS) into the quadratic estimator formalism, thereby putting its statistical properties on stronger theoretical footing. We find that GPR-FS can distort the window functions at these low k modes, which, without proper decorrelation, make it difficult to probe the EoR power spectrum. Incidentally, we also show that GPR-FS is in fact closely related to the widely studied optimal quadratic estimator. As a case study, we look at recent power spectrum upper limits from the Low Frequency Array (LOFAR) that utilized GPR-FS. We pay close attention to their normalization scheme, showing that it is particularly sensitive to signal loss when the EoR covariance is misestimated. This implies possible ramifications for recent astrophysical interpretations of the LOFAR limits, because many of the EoR models ruled out do not fall within the bounds of the covariance models explored by LOFAR. Being more robust to this bias (although not entirely free of it), we conclude that the quadratic estimator is a more natural framework for implementing GPR-FS and computing the 21 cm power spectrum.

arXiv commentaccepted to MNRAS

References in corpus (97)

• SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
• Array Programming with NumPy
• emcee: The MCMC Hammer
• Planck 2015 results. XIII. Cosmological parameters
• LOFAR: The LOw-Frequency ARray
• Cosmology at Low Frequencies: The 21 cm Transition and the High-Redshift Universe
• An absorption profile centred at 78 megahertz in the sky-averaged spectrum
• 21-cm cosmology
• Hydrogen Epoch of Reionization Array (HERA)
• GaLactic and Extragalactic All-sky Murchison Widefield Array (GLEAM) survey I: A low-frequency extragalactic catalogue
• Possible interaction between baryons and dark-matter particles revealed by the first stars
• A model of diffuse Galactic Radio Emission from 10 MHz to 100 GHz
• Reionization and Cosmology with 21 cm Fluctuations
• Cosmological Parameter Estimation Using 21 cm Radiation from the Epoch of Reionization
• The Precision Array for Probing the Epoch of Reionization: 8 Station Results
• How to measure CMB power spectra without losing information
• Bright Source Subtraction Requirements For Redshifted 21 cm Measurements
• What Next-Generation 21 cm Power Spectrum Measurements Can Teach Us About the Epoch of Reionization
• Measurement of 21 cm brightness fluctuations at z ~ 0.8 in cross-correlation
• A simulation calibrated limit on the HI power spectrum from the GMRT Epoch of Reionization experiment
• Science with the Murchison Widefield Array
• Four Fundamental Foreground Power Spectrum Shapes for 21 cm Cosmology Observations
• Improved upper limits on the 21-cm signal power spectrum of neutral hydrogen at $\mathbf{z}\approx 9.1$ from LOFAR
• Upper limits on the 21-cm Epoch of Reionization power spectrum from one night with LOFAR
• How accurately can 21 cm tomography constrain cosmology?
• The Epoch of Reionization Window: I. Mathematical Formalism
• New Limits on 21cm EoR From PAPER-32 Consistent with an X-Ray Heated IGM at z=7.7
• Revisiting the radio interferometer measurement equation. I. A full-sky Jones formalism
• PAPER-64 Constraints on Reionization: The 21cm Power Spectrum at z=8.4
• 21CMMC: an MCMC analysis tool enabling astrophysical parameter studies of the cosmic 21 cm signal
• Concerns about Modelling of the EDGES Data
• Data Analysis for Precision 21 cm Cosmology
• Deep multi-redshift limits on Epoch of Reionisation 21cm Power Spectra from Four Seasons of Murchison Widefield Array Observations
• The Epoch of Reionization Window: II. Statistical Methods for Foreground Wedge Reduction
• Modeling the Radio Background from the First Black Holes at Cosmic Dawn: Implications for the 21 cm Absorption Amplitude
• A lower limit of dz > 0.06 for the duration of the reionization epoch
• A Sensitivity and Array-Configuration Study for Measuring the Power Spectrum of 21cm Emission from Reionization
• An Improved Model of Diffuse Galactic Radio Emission from 10 MHz to 5 THz
• Signature of Excess Radio Background in the 21-cm Global Signal and Power Spectrum
• Overcoming real-world obstacles in 21 cm power spectrum estimation: A method demonstration and results from early Murchison Widefield Array data
• Calibration Requirements for Detecting the 21 cm Epoch of Reionization Power Spectrum and Implications for the SKA
• A Method for 21cm Power Spectrum Estimation in the Presence of Foregrounds
• Opening the 21cm EoR Window: Measurements of Foreground Isolation with PAPER
• Coaxing Cosmic 21cm Fluctuations from the Polarized Sky using m-mode Analysis
• The power spectrum of galaxies in the 2dF 100k redshift survey
• First Season MWA EoR Power Spectrum Results at Redshift 7
• Foregrounds in Wide-Field Redshifted 21 cm Power Spectra
• Testing for calibration systematics in the EDGES low-band data using Bayesian model selection
• A simplified, lossless re-analysis of PAPER-64
• A Ground Plane Artifact that Induces an Absorption Profile in Averaged Spectra from Global 21-cm Measurements - with Possible Application to EDGES
• The Scale of the Problem : Recovering Images of Reionization with GMCA
• Eliminating the optical depth nuisance from the CMB with 21 cm cosmology
• The redshifted 21-cm signal in the EDGES low-band spectrum
• Statistical 21-cm Signal Separation via Gaussian Process Regression Analysis
• The 21 cm Power Spectrum from the Cosmic Dawn: First Results from the OVRO-LWA
• The Impact of Modeling Errors on Interferometer Calibration for 21 cm Power Spectra
• The Global History of Reionisation
• Emulating Simulations of Cosmic Dawn for 21cm Power Spectrum Constraints on Cosmology, Reionization, and X-ray Heating
• First Limits on the 21 cm Power Spectrum during the Epoch of X-ray heating
• Constraining the intergalactic medium at $z\approx$ 9.1 using LOFAR Epoch of Reionization observations
• Non-parametric foreground subtraction for 21cm epoch of reionization experiments
• Towards Optimal Measurement of Power Spectra I: Minimum Variance Pair Weighting and the Fisher Matrix
• First Season MWA Phase II EoR Power Spectrum Results at Redshift 7
• Fundamental Limitations on the Calibration of Redundant 21 cm Cosmology Instruments and Implications for HERA and the SKA
• Calibration of Low-Frequency, Wide-Field Radio Interferometers Using Delay/Delay-Rate Filtering
• SARAS 2: A Spectral Radiometer for probing Cosmic Dawn and the Epoch of Reionization through detection of the global 21 cm signal
• Tight Constraints on the Excess Radio Background at $z=9.1$ from LOFAR
• Multi-redshift limits on the 21cm power spectrum from PAPER
• Interpreting LOFAR 21-cm signal upper limits at z~9.1 in the context of high-z galaxy and reionisation observations
• Mitigating Internal Instrument Coupling II: A Method Demonstration with the Hydrogen Epoch of Reionization Array
• The GMRT EoR Experiment: Limits on Polarized Sky Brightness at 150 MHz
• Characterizing Signal Loss in the 21 cm Reionization Power Spectrum: A Revised Study of PAPER-64
• Erasing the Milky Way: new cleaning technique applied to GBT intensity mapping data
• Extracting HI cosmological signal with Generalized Needlet Internal Linear Combination
• Understanding the Diversity of 21 cm Cosmology Analyses
• Recovery of 21 cm intensity maps with sparse component separation
• The impact of interference excision on 21-cm Epoch of Reionization power spectrum analyses
• Constraining High Redshift X-ray Sources with Next Generation 21 cm Power Spectrum Measurements
• Comparing Foreground Removal Techniques for Recovery of the LOFAR-EoR 21cm Power Spectrum
• Redundant-Baseline Calibration of the Hydrogen Epoch of Reionization Array
• The FHD/$\mathbf{\epsilon }$ppsilon Epoch of Reionization Power Spectrum Pipeline
• DAYENU: A Simple Filter of Smooth Foregrounds for Intensity Mapping Power Spectra
• Absolute Calibration Strategies for the Hydrogen Epoch of Reionization Array and Their Impact on the 21 cm Power Spectrum
• Polarized Redundant-Baseline Calibration for 21 cm Cosmology Without Adding Spectral Structure
• Global 21-cm signal extraction from foreground and instrumental effects I: Pattern recognition framework for separation using training sets
• Improved 21 cm Epoch Of Reionization Power Spectrum Measurements with a Hybrid Foreground Subtraction and Avoidance Technique
• Erasing the variable: Empirical foreground discovery for global 21 cm spectrum experiments
• Low-l CMB Analysis and Inpainting
• Constraints on the temperature of the intergalactic medium at z=8.4 with 21-cm observations
• Wide-field LOFAR-LBA power-spectra analyses: Impact of calibration, polarization leakage and ionosphere
• Bayesian semi-blind component separation for foreground removal in interferometric 21-cm observations
• Using inpainting to construct accurate cut-sky CMB estimators
• Calibration and 21-cm Power Spectrum Estimation in the Presence of Antenna Beam Variations
• Foreground modelling via Gaussian process regression: an application to HERA data
• Detection of Cosmic Structures using the Bispectrum Phase. II. First Results from Application to Cosmic Reionization Using the Hydrogen Epoch of Reionization Array
• The HERA-19 Commissioning Array: Direction Dependent Effects
• A Bayesian analysis of redshifted 21-cm HI signal and foregrounds: Simulations for LOFAR

Cited by in corpus (37)

• First Results from HERA Phase I: Upper Limits on the Epoch of Reionization 21 cm Power Spectrum
• HERA Phase I Limits on the Cosmic 21-cm Signal: Constraints on Astrophysics and Cosmology During the Epoch of Reionization
• Simulation-Based Inference of Reionization Parameters From 3D Tomographic 21 cm Lightcone Images
• First upper limits on the 21 cm signal power spectrum from cosmic dawn from one night of observations with NenuFAR
• Gaussian Process Regression for foreground removal in HI intensity mapping experiments
• Deeper multi-redshift upper limits on the Epoch of Reionization 21-cm signal power spectrum from LOFAR between z=8.3 and z=10.1
• Validation of the HERA Phase I Epoch of Reionization 21 cm Power Spectrum Software Pipeline
• Statistical recovery of 21cm visibilities and their power spectra with Gaussian constrained realisations and Gibbs sampling
• Cleaning foregrounds from single-dish 21cm intensity maps with Kernel Principal Component Analysis
• Exploring the cosmic dawn and epoch of reionization with 21cm line
• Detecting the HI Power Spectrum in the Post-Reionization Universe with SKA-Low
• Exploring the consequences of chromatic data excision in 21-cm Epoch of Reionization power spectrum observations
• Characterization Of Inpaint Residuals In Interferometric Measurements of the Epoch Of Reionization
• The Tracking Tapered Gridded Estimator for the 21-cm power spectrum from MWA drift scan observations I: Validation and preliminary results
• Towards $21$-cm intensity mapping at $z=2.28$ with uGMRT using the tapered gridded estimator III: Foreground removal
• 21-cm foreground removal using AI and frequency-difference technique
• Emission-line Stacking of 21cm Intensity Maps with MeerKLASS: Inference Pipeline and Application to the L-band Deep-field Data
• Towards $21$-cm intensity mapping at $z=2.28$ with uGMRT using the tapered gridded estimator -- IV. Wideband analysis
• Towards $21$-cm intensity mapping at $z=2.28$ with uGMRT using the tapered gridded estimator II: Cross-polarization power spectrum
• First upper limits on the 21-cm signal power spectrum of neutral hydrogen at $z=9.16$ from the LOFAR 3C196 field
• Why and When to Expect Gaussian Error Distributions in Epoch of Reionization 21-cm Power Spectrum Measurements
• Towards Optimal Foreground Mitigation Strategies for Interferometric HI Intensity Mapping in the Low-Redshift Universe
• A Differentiable, End-to-End Forward Model for 21 cm Cosmology: Estimating the Foreground, Instrument, and Signal Joint Posterior
• Bayesian evidence for flux scale errors in Galactic synchrotron maps
• Deep learning approach for identification of HII regions during reionization in 21-cm observations -- III. image recovery
• Field-level Reconstruction from Foreground-Contaminated 21-cm Maps
• Simulations of primary beam effects on the cosmic bispectrum phase observed with the Hydrogen Epoch of Reionization Array
• Ionospheric effect on the synthetic Epoch of Reionization observations with the SKA1-Low
• Exploring One-point Statistics in HERA Phase I Data: Effects of Foregrounds and Systematics on Measuring One-Point Statistics
• Foreground removal and angular power spectrum estimation of 21 cm signal using harmonic space ILC method
• Mapping neutral islands during end stages of reionization with photometric intergalactic medium tomography
• A quadratic estimator view of the transfer function correction in intensity mapping surveys
• Deep learning with hybrid frequency differencing and principal component analysis for 21-cm foreground and beam mitigation
• Power spectrum multipoles and clustering wedges during the Epoch of Reionization
• Mitigating gain calibration errors from EoR observations with SKA1-Low AA*
• Photometry on Structured Backgrounds: Local Pixelwise Infilling by Regression
• Bayes-SCF: A Bayesian filter to mitigate foreground leakage in the 21-cm power spectrum