The Epoch of Reionization Window: II. Statistical Methods for Foreground Wedge Reduction

Abstract

For there to be a successful measurement of the 21 cm Epoch of Reionization (EoR) power spectrum, it is crucial that strong foreground contaminants be robustly suppressed. These foregrounds come from a variety of sources (such as Galactic synchrotron emission and extragalactic point sources), but almost all share the property of being spectrally smooth, and when viewed through the chromatic response of an interferometer, occupy a signature "wedge" region in cylindrical $k_{\perp }{k}_{\parallel }$ Fourier space. The complement of the foreground wedge is termed the "EoR window", and is expected to be mostly foreground-free, allowing clean measurements of the power spectrum. This paper is a sequel to a previous paper that established a rigorous mathematical framework for describing the foreground wedge and the EoR window. Here, we use our framework to explore statistical methods by which the EoR window can be enlarged, thereby increasing the sensitivity of a power spectrum measurement. We adapt the FKP approximation (commonly used in galaxy surveys) for 21 cm cosmology, and also compare the optimal quadratic estimator to simpler estimators that ignore covariances between different Fourier modes. The optimal quadratic estimator is found to suppress foregrounds by an extra factor of $\sim 10^5$ in power at the peripheries of the EoR window, boosting the detection of the cosmological signal from $12\sigma$ to $50\sigma$ at the midpoint of reionization in our fiducial models. If numerical issues can be finessed, decorrelation techniques allow the EoR window to be further enlarged, enabling measurements to be made deep within the foreground wedge. These techniques do not assume that foreground are Gaussian-distributed, and we additionally prove that a final round of foreground subtraction can be performed after decorrelation in a way that is guaranteed to have no cosmological signal loss.

arXiv comment19 pages, 8 figures. v2: Updated to match published PRD version. Fixed typos, added figure showing fiducial theoretical model, appendix about Fisher matrices, and detection significance figures in response to referee comments. Main conclusions unchanged

References in corpus (60)

• Cosmology at Low Frequencies: The 21 cm Transition and the High-Redshift Universe
• The Murchison Widefield Array: the Square Kilometre Array Precursor at low radio frequencies
• 21-cm cosmology
• Power Spectrum Analysis of Three-Dimensional Redshift Surveys
• A model of diffuse Galactic Radio Emission from 10 MHz to 100 GHz
• Reionization and Cosmology with 21 cm Fluctuations
• Cosmological Parameter Estimation Using 21 cm Radiation from the Epoch of Reionization
• The Precision Array for Probing the Epoch of Reionization: 8 Station Results
• Estimating the Power Spectrum of the Cosmic Microwave Background
• How to measure CMB power spectra without losing information
• Bright Source Subtraction Requirements For Redshifted 21 cm Measurements
• What Next-Generation 21 cm Power Spectrum Measurements Can Teach Us About the Epoch of Reionization
• Reionization and the Cosmic Dawn with the Square Kilometre Array
• Measurement of 21 cm brightness fluctuations at z ~ 0.8 in cross-correlation
• A simulation calibrated limit on the HI power spectrum from the GMRT Epoch of Reionization experiment
• A Per-Baseline, Delay-Spectrum Technique for Accessing the 21cm Cosmic Reionization Signature
• Science with the Murchison Widefield Array
• Four Fundamental Foreground Power Spectrum Shapes for 21 cm Cosmology Observations
• How accurately can 21 cm tomography constrain cosmology?
• The Epoch of Reionization Window: I. Mathematical Formalism
• New Limits on 21cm EoR From PAPER-32 Consistent with an X-Ray Heated IGM at z=7.7
• Determination of z~0.8 neutral hydrogen fluctuations using the 21 cm intensity mapping auto-correlation
• How to make maps from CMB data without losing information
• Imaging the Epoch of Reionization: limitations from foreground confusion and imaging algorithms
• Measuring the galaxy power spectrum with future redshift surveys
• Comparison Of Reionization Models: Radiative Transfer Simulations And Approximate, Semi-Numeric Models
• The impact of point source subtraction residuals on 21 cm Epoch of Reionization estimation
• A Sensitivity and Array-Configuration Study for Measuring the Power Spectrum of 21cm Emission from Reionization
• Overcoming real-world obstacles in 21 cm power spectrum estimation: A method demonstration and results from early Murchison Widefield Array data
• All-Sky Interferometry with Spherical Harmonic Transit Telescopes
• The GMRT-EoR Experiment: A new upper limit on the neutral hydrogen power spectrum at z~8.6
• Foreground Contamination in Interferometric Measurements of the Redshifted 21 cm Power Spectrum
• A Method for 21cm Power Spectrum Estimation in the Presence of Foregrounds
• Opening the 21cm EoR Window: Measurements of Foreground Isolation with PAPER
• Foreground Removal using FastICA: A Showcase of LOFAR-EoR
• Twenty-one centimeter tomography with foregrounds
• The Baryon Acoustic Oscillation Broadband and Broad-beam Array: Design Overview and Sensitivity Forecasts
• A study of fundamental limitations to statistical detection of redshifted HI from the epoch of reionization
• How to measure CMB polarization power spectra without losing information
• Initial deep LOFAR observations of Epoch of Reionization windows: I. The North Celestial Pole
• The Tianlai project: a 21cm cosmology experiment
• Power Spectrum Sensitivity and the Design of Epoch of Reionization Observatories
• The Scale of the Problem : Recovering Images of Reionization with GMCA
• Foregrounds for 21cm Observations of Neutral Gas at High Redshift
• An Improved Method for 21cm Foreground Removal
• Non-parametric foreground subtraction for 21cm epoch of reionization experiments
• How well can we measure and understand foregrounds with 21 cm experiments?
• A 189 MHz, 2400 square degree polarization survey with the Murchison Widefield Array 32-element prototype
• The Fundamental Multi-Baseline Mode-Mixing Foreground in 21 cm EoR Observations
• Will point sources spoil 21 cm tomography?
• De-contamination of cosmological 21-cm maps
• Systematic Effects of Foreground Removal in 21cm Surveys of Reionization
• A Fast Method for Power Spectrum and Foreground Analysis for 21 cm Cosmology
• Higher Order Contributions to the 21 cm Power Spectrum
• The nature of dark matter from the global high redshift HI 21 cm signal
• Software Holography: Interferometric Data Analysis for the Challenges of Next Generation Observatories
• Studying the Sources of Cosmic Reionization with 21-cm Fluctuations
• Primordial Non-Gaussianity Estimation using 21 cm Tomography from the Epoch of Reionization
• A Technique for Foreground Subtraction in Redshifted 21 cm Observations
• BAORadio: A digital pipeline for radio interferometry and 21 cm mapping of large scale structures

Cited by in corpus (158)

• Hydrogen Epoch of Reionization Array (HERA)
• Improved upper limits on the 21-cm signal power spectrum of neutral hydrogen at $\mathbf{z}\approx 9.1$ from LOFAR
• The Epoch of Reionization Window: I. Mathematical Formalism
• 21CMMC: an MCMC analysis tool enabling astrophysical parameter studies of the cosmic 21 cm signal
• Data Analysis for Precision 21 cm Cosmology
• First Results from HERA Phase I: Upper Limits on the Epoch of Reionization 21 cm Power Spectrum
• An Improved Model of Diffuse Galactic Radio Emission from 10 MHz to 5 THz
• Improved Constraints on the 21 cm EoR Power Spectrum and the X-Ray Heating of the IGM with HERA Phase I Observations
• First Season MWA EoR Power Spectrum Results at Redshift 7
• Foregrounds in Wide-Field Redshifted 21 cm Power Spectra
• A simplified, lossless re-analysis of PAPER-64
• Statistical 21-cm Signal Separation via Gaussian Process Regression Analysis
• Empirical Covariance Modeling for 21 cm Power Spectrum Estimation: A Method Demonstration and New Limits from Early Murchison Widefield Array 128-Tile Data
• The Impact of Modeling Errors on Interferometer Calibration for 21 cm Power Spectra
• Emulating Simulations of Cosmic Dawn for 21cm Power Spectrum Constraints on Cosmology, Reionization, and X-ray Heating
• First Limits on the 21 cm Power Spectrum during the Epoch of X-ray heating
• Constraining the intergalactic medium at $z\approx$ 9.1 using LOFAR Epoch of Reionization observations
• Probing the Small-Scale Matter Power Spectrum with Large-Scale 21-cm Data
• The Importance of Wide-field Foreground Removal for 21 cm Cosmology: A Demonstration With Early MWA Epoch of Reionization Observations
• Interpreting the unresolved intensity of cosmologically redshifted line radiation
• Effects of Antenna Beam Chromaticity on Redshifted 21~cm Power Spectrum and Implications for Hydrogen Epoch of Reionization Array
• High-redshift post-reionization cosmology with 21cm intensity mapping
• Redundant Array Configurations for 21 cm Cosmology
• The Murchison Widefield Array 21 cm Power Spectrum Analysis Methodology
• Characterizing Signal Loss in the 21 cm Reionization Power Spectrum: A Revised Study of PAPER-64
• Mitigating the Effects of Antenna-to-Antenna Variation on Redundant-Baseline Calibration for 21 cm Cosmology
• The Hydrogen Epoch of Reionization Array Dish I: Beam Pattern Measurements and Science Implications
• Understanding the Diversity of 21 cm Cosmology Analyses
• Statistics of the epoch of reionization (EoR) 21-cm signal -- II. The evolution of the power spectrum error-covariance
• Constraining cosmology and ionization history with combined 21 cm power spectrum and global signal measurements
• A Standard Ruler at Cosmic Dawn
• Reconstructing large-scale structure with neutral hydrogen surveys
• Constraining the state of the intergalactic medium during the Epoch of Reionization using MWA 21-cm signal observations
• Visibility based angular power spectrum estimation in low frequency radio interferometric observations
• Constraining High Redshift X-ray Sources with Next Generation 21 cm Power Spectrum Measurements
• Inflation and Early Dark Energy with a Stage II Hydrogen Intensity Mapping Experiment
• Redundant-Baseline Calibration of the Hydrogen Epoch of Reionization Array
• Measuring Phased-Array Antenna Beampatterns with High Dynamic Range for the Murchison Widefield Array using 137 MHz ORBCOMM Satellites
• The foreground wedge and 21 cm BAO surveys
• Gaussian Process Foreground Subtraction and Power Spectrum Estimation for 21 cm Cosmology
• Spherical Harmonic Analyses of Intensity Mapping Power Spectra
• An Effective Model for the Cosmic-Dawn 21-cm Signal
• The impact of spin temperature fluctuations on the 21-cm moments
• Recovering the Wedge Modes Lost to 21-cm Foregrounds
• Mapmaking for Precision 21 cm Cosmology
• Measuring the Cosmological 21 cm Monopole with an Interferometer
• DAYENU: A Simple Filter of Smooth Foregrounds for Intensity Mapping Power Spectra
• The visibility based Tapered Gridded Estimator (TGE) for the redshifted 21-cm power spectrum
• Polarized Redundant-Baseline Calibration for 21 cm Cosmology Without Adding Spectral Structure
• Adding Context to JWST Surveys with Current and Future 21cm Radio Observations
• Machine learning astrophysics from 21 cm lightcones: impact of network architectures and signal contamination
• Calibrating photometric redshifts with intensity mapping observations
• Optimized Beam Sculpting with Generalized Fringe-Rate Filters
• The Hydrogen Epoch of Reionization Array Dish II: Characterization of Spectral Structure with Electromagnetic Simulations and its science Implications
• Improved 21 cm Epoch Of Reionization Power Spectrum Measurements with a Hybrid Foreground Subtraction and Avoidance Technique
• Probing the Intergalactic Medium with Ly$\alpha$ and 21 cm Fluctuations
• The 21-cm Line as a Probe of Reionization
• Cross-correlation of the cosmic 21-cm signal and Lyman Alpha Emitters during reionization
• Exploring the likelihood of the 21-cm power spectrum with simulation-based inference
• Intensity mapping with neutral hydrogen and the Hidden Valley simulations
• Exploring the cosmic 21-cm signal from the Epoch of Reionisation using the Wavelet Scattering Transform
• Tapering the sky response for angular power spectrum estimation from low-frequency radio-interferometric data
• 21cmEMU: an emulator of 21cmFAST summary observables
• Constraints on the temperature of the intergalactic medium at z=8.4 with 21-cm observations
• Patterns of primary beam non-redundancy in close-packed 21 cm array observations
• The foreground transfer function for HI intensity mapping signal reconstruction: MeerKLASS and precision cosmology applications
• Bayesian semi-blind component separation for foreground removal in interferometric 21-cm observations
• Hydrogen Epoch of Reionization Array (HERA) Phase II Deployment and Commissioning
• Combining galaxy and 21cm surveys
• Constraining Polarized Foregrounds for EoR Experiments I: 2D Power Spectra from the PAPER-32 Imaging Array
• Measuring the growth of structure with intensity mapping surveys
• Constraining Polarized Foregrounds for EOR Experiments II: Polarization Leakage Simulations in the Avoidance Scheme
• Brute-Force Mapmaking with Compact Interferometers: A MITEoR Northern Sky Map from 128 MHz to 175 MHz
• Demonstrating the Tapered Gridded Estimator (TGE) for the Cosmological HI 21-cm Power Spectrum using $150\mathrm{MHz}$ GMRT observations
• Quantifying Excess Power from Radio Frequency Interference in Epoch of Reionization Measurements
• Simulations of Galactic polarized synchrotron emission for Epoch of Reionization observations
• Probing ultra-light axions with the 21-cm Signal during Cosmic Dawn
• A Bayesian Calibration Framework for EDGES
• Deeper multi-redshift upper limits on the Epoch of Reionization 21-cm signal power spectrum from LOFAR between z=8.3 and z=10.1
• A Tapered Gridded Estimator (TGE) for the Multi-Frequency Angular Power Spectrum (MAPS) and the Cosmological HI 21-cm Power Spectrum
• A direct detection of neutral hydrogen intensity mapping on Mpc scales at $z\approx 0.32$ and $z\approx 0.44$
• Detecting Cosmic Reionization using Bi-Spectrum Phase
• The effect of baseline layouts on the EoR foreground wedge: a semi-analytical approach
• Modeling HI at the field level
• Spectral performance of SKA Log-periodic Antennas I: Mitigating spectral artefacts in SKA1-LOW 21-cm cosmology experiments
• The HERA-19 Commissioning Array: Direction Dependent Effects
• Statistical recovery of 21cm visibilities and their power spectra with Gaussian constrained realisations and Gibbs sampling
• Deep learning approach for identification of HII regions during reionization in 21-cm observations -- II. foreground contamination
• Measuring HERA's primary beam in-situ: methodology and first results
• The Dark Ages' 21-cm Trispectrum
• Reionisation & Cosmic Dawn Astrophysics from the Square Kilometre Array: Impact of Observing Strategies
• Synergies between radio, optical and microwave observations at high redshift
• An Effective Bias Expansion for 21 cm Cosmology in Redshift Space
• Delay Spectrum with Phase-Tracking Arrays: Extracting the HI power spectrum from the Epoch of Reionization
• Density reconstruction from biased tracers and its application to primordial non-Gaussianity
• Evidence of Ultra-faint Radio Frequency Interference in Deep 21~cm Epoch of Reionization Power Spectra with the Murchison Widefield Array
• The Hydrogen Epoch of Reionization Array Dish III: Measuring Chromaticity of Prototype Element with Reflectometry
• How informative are summaries of the cosmic 21-cm signal?
• Methods of Error Estimation for Delay Power Spectra in $21\text{cm}$ Cosmology
• Beamforming Errors in Murchison Widefield Array Phased Array Antennas and their effects on Epoch of Reionization Science
• Machine-learning recovery of foreground wedge-removed 21-cm light cones for high-$z$ galaxy mapping
• Exploring the cosmic dawn and epoch of reionization with 21cm line
• On the use of temporal filtering for mitigating galactic synchrotron calibration bias in 21 cm reionization observations
• Variations in fundamental constants at the cosmic dawn
• Detecting the non-Gaussianity of the 21-cm signal during reionisation with the Wavelet Scattering Transform
• Probing early universe through redshifted 21-cm signal: Modelling and observational challenges
• Impact of instrument and data characteristics in the interferometric reconstruction of the 21 cm power spectrum
• Beyond the horizon: Quantifying the full sky foreground wedge in the cylindrical power spectrum
• Probing Compensated Isocurvature with the 21-cm Signal during Cosmic Dawn
• Forecasts and Statistical Insights for Line Intensity Mapping Cross-Correlations: A Case Study with 21cm x [CII]
• A partial inventory of observational anisotropies in single-dish line-intensity mapping
• Constraints on the state of the IGM at $z\sim 8-10$ using redshifted 21-cm observations with LOFAR
• Statistical Detection of IGM Structures during Cosmic Reionization using Absorption of the Redshifted 21 cm line by HI against Compact Background Radio Sources
• Emulation of the Cosmic Dawn 21-cm Power Spectrum and Classification of Excess Radio Models Using an Artificial Neural Network
• Sensitivity of the Hydrogen Epoch of Reionization Array and its Build-out Stages to One-point Statistics from Redshifted 21 cm Observations
• Generating extremely large-volume reionisation simulations
• Ionospheric Attenuation of Polarized Foregrounds in 21 cm Epoch of Reionization Measurements: A Demonstration for the HERA Experiment
• HI intensity mapping with the MIGHTEE survey: power spectrum estimates
• Delensing Degree-Scale $B$-Mode Polarization with High-Redshift Line Intensity Mapping
• HI intensity mapping with MeerKAT: forecast for delay power spectrum measurement using interferometer mode
• Probing delayed-end reionization histories with the 21cm-LAE cross-power spectrum
• Towards $21$-cm intensity mapping at $z=2.28$ with uGMRT using the tapered gridded estimator III: Foreground removal
• Detection of Cosmic Structures using the Bispectrum Phase. I. Mathematical Foundations
• Probing the intergalactic medium during the Epoch of Reionization using 21-cm signal power spectra
• Estimation of HII Bubble Size Distribution from 21cm Power Spectrum with Artificial Neural Networks
• Spectral modelling of Cygnus A between 110 and 250 MHz. Impact on the LOFAR 21-cm signal power spectrum
• Towards $21$-cm intensity mapping at $z=2.28$ with uGMRT using the tapered gridded estimator II: Cross-polarization power spectrum
• Validating a novel angular power spectrum estimator using simulated low frequency radio-interferometric data
• Unlocking Sensitivity for Visibility-based Estimators of the 21 cm Reionization Power Spectrum
• Detecting galaxy-21-cm cross-correlation during reionization
• The primordial information content of Rayleigh Anisotropies
• First upper limits on the 21-cm signal power spectrum of neutral hydrogen at $z=9.16$ from the LOFAR 3C196 field
• SKATR: A Self-Supervised Summary Transformer for SKA
• Measuring the reionization 21 cm fluctuations using clustering wedges
• Probing light relics through cosmic dawn
• Measurements of one-point statistics in 21 cm intensity maps via foreground avoidance strategy
• Towards Optimal Foreground Mitigation Strategies for Interferometric HI Intensity Mapping in the Low-Redshift Universe
• The Effect of Interplanetary Scintillation on Epoch of Reionisation Power Spectra
• The Tracking Tapered Gridded Estimator (TTGE) for the power spectrum from drift scan observations
• Elucidating Dark Energy with Future 21 cm Observations at the Epoch of Reionization
• 21-cm Constraints on Dark Matter Annihilation after an Early Matter-Dominated Era
• Understanding spectral artefacts in SKA-LOW 21-cm cosmology experiments: the impact of cable reflections
• Deep learning approach for identification of HII regions during reionization in 21-cm observations -- III. image recovery
• Strategy for mitigation of systematics for EoR experiments with the Murchison Widefield Array
• 21 cm Intensity Mapping with the DSA-2000
• Reaching small scales with low frequency imaging: applications to the Dark Ages
• Cross-correlation of the Polarizations of the 21-cm and Cosmic Microwave Backgrounds
• Separating Angular and Radial Modes with Spherical-Fourier Bessel Power Spectrum on All Scales and Implications for Systematics Mitigation
• A Digital Calibration Source for 21cm Cosmology Telescopes
• Calibration requirement for Epoch of Reionization 21-cm signal observation -- III. Bias and variance in uGMRT ELAIS-N1 field power spectrum
• An Alcock-Paczynski Test on Reionization Bubbles for Cosmology
• Optimising the Processing and Storage of Visibilities using lossy compression
• Beyond the Power Spectrum: A New Framework for Non-Stationary Fields with Applications to Light-Cone Effects in Line Intensity Mapping
• Impact of 21-cm foreground mitigation strategies on reionization power spectrum constraints
• The Correlation Calibration of PAPER-64 data
• Mitigating gain calibration errors from EoR observations with SKA1-Low AA*
• Testing the growth of cosmic structures during the Dark Ages
• Sample Variance Denoising in Cylindrical 21-cm Power Spectra