Four Fundamental Foreground Power Spectrum Shapes for 21 cm Cosmology Observations

Abstract

Contamination from instrumental effects interacting with bright astrophysical sources is the primary impediment to measuring Epoch of Reionization and BAO 21 cm power spectra---an effect called mode-mixing. In this paper we identify four fundamental power spectrum shapes produced by mode-mixing that will affect all upcoming observations. We are able, for the first time, to explain the wedge-like structure seen in advanced simulations and to forecast the shape of an 'EoR window' that is mostly free of contamination. Understanding the origins of these contaminations also enables us to identify calibration and foreground subtraction errors below the imaging limit, providing a powerful new tool for precision observations.

arXiv commentAccepted for publication in ApJ, minor clarifications in the text

Cited by in corpus (235)

• Hydrogen Epoch of Reionization Array (HERA)
• What Next-Generation 21 cm Power Spectrum Measurements Can Teach Us About the Epoch of Reionization
• Late-time cosmology with 21cm intensity mapping experiments
• A Per-Baseline, Delay-Spectrum Technique for Accessing the 21cm Cosmic Reionization Signature
• Science with the Murchison Widefield Array
• Improved upper limits on the 21-cm signal power spectrum of neutral hydrogen at $\mathbf{z}\approx 9.1$ from LOFAR
• The Epoch of Reionization Window: I. Mathematical Formalism
• 21CMMC: an MCMC analysis tool enabling astrophysical parameter studies of the cosmic 21 cm signal
• Data Analysis for Precision 21 cm Cosmology
• The Epoch of Reionization Window: II. Statistical Methods for Foreground Wedge Reduction
• The impact of point source subtraction residuals on 21 cm Epoch of Reionization estimation
• An Improved Model of Diffuse Galactic Radio Emission from 10 MHz to 5 THz
• Overcoming real-world obstacles in 21 cm power spectrum estimation: A method demonstration and results from early Murchison Widefield Array data
• Calibration Requirements for Detecting the 21 cm Epoch of Reionization Power Spectrum and Implications for the SKA
• Opening the 21cm EoR Window: Measurements of Foreground Isolation with PAPER
• Coaxing Cosmic 21cm Fluctuations from the Polarized Sky using m-mode Analysis
• The signature of the first stars in atomic hydrogen at redshift 20
• First Season MWA EoR Power Spectrum Results at Redshift 7
• HERA Phase I Limits on the Cosmic 21-cm Signal: Constraints on Astrophysics and Cosmology During the Epoch of Reionization
• A study of fundamental limitations to statistical detection of redshifted HI from the epoch of reionization
• Foregrounds in Wide-Field Redshifted 21 cm Power Spectra
• Improving the Epoch of Reionization Power Spectrum Results from Murchison Widefield Array Season 1 Observations
• CHIPS: The Cosmological HI Power Spectrum Estimator
• Statistical 21-cm Signal Separation via Gaussian Process Regression Analysis
• Empirical Covariance Modeling for 21 cm Power Spectrum Estimation: A Method Demonstration and New Limits from Early Murchison Widefield Array 128-Tile Data
• The 21 cm Power Spectrum from the Cosmic Dawn: First Results from the OVRO-LWA
• The Impact of Modeling Errors on Interferometer Calibration for 21 cm Power Spectra
• Systematic biases in low frequency radio interferometric data due to calibration: the LOFAR EoR case
• Emulating Simulations of Cosmic Dawn for 21cm Power Spectrum Constraints on Cosmology, Reionization, and X-ray Heating
• First Limits on the 21 cm Power Spectrum during the Epoch of X-ray heating
• A 189 MHz, 2400 square degree polarization survey with the Murchison Widefield Array 32-element prototype
• Probing the Small-Scale Matter Power Spectrum with Large-Scale 21-cm Data
• First Season MWA Phase II EoR Power Spectrum Results at Redshift 7
• Fundamental Limitations on the Calibration of Redundant 21 cm Cosmology Instruments and Implications for HERA and the SKA
• The Fundamental Multi-Baseline Mode-Mixing Foreground in 21 cm EoR Observations
• Confirmation of Wide-Field Signatures in Redshifted 21 cm Power Spectra
• The Importance of Wide-field Foreground Removal for 21 cm Cosmology: A Demonstration With Early MWA Epoch of Reionization Observations
• Foreground Model and Antenna Calibration Errors in the Measurement of the Sky-Averaged λ21 cm Signal at z~20
• Reionization and Beyond: detecting the peaks of the cosmological 21cm signal
• Extending cosmological tests of General Relativity with the Square Kilometre Array
• Multi-redshift limits on the 21cm power spectrum from PAPER
• The Effects of Polarized Foregrounds on 21cm Epoch of Reionization Power Spectrum Measurements
• Effects of Antenna Beam Chromaticity on Redshifted 21~cm Power Spectrum and Implications for Hydrogen Epoch of Reionization Array
• Mitigating Internal Instrument Coupling II: A Method Demonstration with the Hydrogen Epoch of Reionization Array
• Parametrising Epoch of Reionization foregrounds: A deep survey of low-frequency point-source spectra with the MWA
• High-redshift post-reionization cosmology with 21cm intensity mapping
• Redundant Array Configurations for 21 cm Cosmology
• The Murchison Widefield Array 21 cm Power Spectrum Analysis Methodology
• A Fast Method for Power Spectrum and Foreground Analysis for 21 cm Cosmology
• The EoR Sensitivity of the Murchison Widefield Array
• An Intensity Mapping Detection of Aggregate CO Line Emission at 3 mm
• Robust Velocity-induced Acoustic Oscillations at Cosmic Dawn
• A new MWA limit on the 21 cm Power Spectrum at Redshifts $\sim$ 13 $-$ 17
• Mitigating the Effects of Antenna-to-Antenna Variation on Redundant-Baseline Calibration for 21 cm Cosmology
• The Hydrogen Epoch of Reionization Array Dish I: Beam Pattern Measurements and Science Implications
• Understanding the Diversity of 21 cm Cosmology Analyses
• Constraining cosmology and ionization history with combined 21 cm power spectrum and global signal measurements
• The Impact of Foregrounds on Redshift Space Distortion Measurements With the Highly-Redshifted 21 cm Line
• A Standard Ruler at Cosmic Dawn
• Reconstructing large-scale structure with neutral hydrogen surveys
• Constraining the epoch of reionization with the variance statistic: simulations of the LOFAR case
• The impact of interference excision on 21-cm Epoch of Reionization power spectrum analyses
• Constraining High Redshift X-ray Sources with Next Generation 21 cm Power Spectrum Measurements
• First upper limits on the 21 cm signal power spectrum from cosmic dawn from one night of observations with NenuFAR
• Precise measurements of inflationary features with 21 cm observations
• Inflation and Early Dark Energy with a Stage II Hydrogen Intensity Mapping Experiment
• Comparing Redundant and Sky Model Based Interferometric Calibration: A First Look with Phase II of the MWA
• Gaussian Process Foreground Subtraction and Power Spectrum Estimation for 21 cm Cosmology
• The foreground wedge and 21 cm BAO surveys
• Measuring Phased-Array Antenna Beampatterns with High Dynamic Range for the Murchison Widefield Array using 137 MHz ORBCOMM Satellites
• Spherical Harmonic Analyses of Intensity Mapping Power Spectra
• The FHD/$\mathbf{\epsilon }$ppsilon Epoch of Reionization Power Spectrum Pipeline
• The impact of spin temperature fluctuations on the 21-cm moments
• Recovering the Wedge Modes Lost to 21-cm Foregrounds
• Mapmaking for Precision 21 cm Cosmology
• Measuring the Cosmological 21 cm Monopole with an Interferometer
• Absolute Calibration Strategies for the Hydrogen Epoch of Reionization Array and Their Impact on the 21 cm Power Spectrum
• DAYENU: A Simple Filter of Smooth Foregrounds for Intensity Mapping Power Spectra
• HI 21cm Cosmology and the Bi-spectrum: Closure Diagnostics in Massively Redundant Interferometric Arrays
• First Results from COPSS: The CO Power Spectrum Survey
• Adding Context to JWST Surveys with Current and Future 21cm Radio Observations
• Machine learning astrophysics from 21 cm lightcones: impact of network architectures and signal contamination
• Polarized Redundant-Baseline Calibration for 21 cm Cosmology Without Adding Spectral Structure
• The AARTFAAC Cosmic Explorer: observations of the 21-cm power spectrum in the EDGES absorption trough
• The Hydrogen Epoch of Reionization Array Dish II: Characterization of Spectral Structure with Electromagnetic Simulations and its science Implications
• The Bias and Uncertainty of Redundant and Sky-Based Calibration under Realistic Sky and Telescope Conditions
• Improved 21 cm Epoch Of Reionization Power Spectrum Measurements with a Hybrid Foreground Subtraction and Avoidance Technique
• Probing the Intergalactic Medium with Ly$\alpha$ and 21 cm Fluctuations
• Erasing the variable: Empirical foreground discovery for global 21 cm spectrum experiments
• The 21-cm Line as a Probe of Reionization
• Polarization leakage in epoch of reionization windows: II. Primary beam model and direction dependent calibration
• A Unified Calibration Framework for 21 cm Cosmology
• Exploring the likelihood of the 21-cm power spectrum with simulation-based inference
• PUMA: The Positional Update and Matching Algorithm
• Machine Learning Applied to the Reionization History of the Universe in the 21 cm Signal
• Exploring the cosmic 21-cm signal from the Epoch of Reionisation using the Wavelet Scattering Transform
• Background reionization history from omniscopes
• Polarization leakage in epoch of reionization windows: III. Wide-field effects of narrow-field arrays
• Intensity mapping with neutral hydrogen and the Hidden Valley simulations
• Cosmic tidal reconstruction
• Combining galaxy and 21cm surveys
• Bayesian semi-blind component separation for foreground removal in interferometric 21-cm observations
• Hydrogen Epoch of Reionization Array (HERA) Phase II Deployment and Commissioning
• Constraining Polarized Foregrounds for EoR Experiments I: 2D Power Spectra from the PAPER-32 Imaging Array
• Measuring the growth of structure with intensity mapping surveys
• Gridded and direct Epoch of Reionisation bispectrum estimates using the Murchison Widefield Array
• Reconstructing the nature of the first cosmic sources from the anisotropic 21-cm signal
• Array Element Coupling in Radio Interferometry I: A Semi-Analytic Approach
• Measuring the X-ray Background in the Reionization Era with First Generation 21 cm Experiments
• Constraining Polarized Foregrounds for EOR Experiments II: Polarization Leakage Simulations in the Avoidance Scheme
• A high resolution foreground model for the MWA EoR1 field: model and implications for EoR power spectrum analysis
• New Limits on Polarized Power Spectra at 126 and 164 MHz: Relevance to Epoch of Reionization Measurements
• Recovering lost 21 cm radial modes via cosmic tidal reconstruction
• Quantifying Excess Power from Radio Frequency Interference in Epoch of Reionization Measurements
• Foreground modelling via Gaussian process regression: an application to HERA data
• Predictions for measuring the 21-cm multi-frequency angular power spectrum using SKA-Low
• Deeper multi-redshift upper limits on the Epoch of Reionization 21-cm signal power spectrum from LOFAR between z=8.3 and z=10.1
• A Flux Scale for Southern Hemisphere 21cm EoR Experiments
• Deconvolving the Wedge: Maximum-Likelihood Power Spectra via Spherical-Wave Visibility Modeling
• A direct detection of neutral hydrogen intensity mapping on Mpc scales at $z\approx 0.32$ and $z\approx 0.44$
• Detecting Cosmic Reionization using Bi-Spectrum Phase
• The effect of baseline layouts on the EoR foreground wedge: a semi-analytical approach
• The 21 cm-kSZ-kSZ Bispectrum during the Epoch of Reionization
• ETHOS -- An Effective Theory of Structure Formation: Impact of Dark Acoustic Oscillations on Cosmic Dawn
• Spectral performance of SKA Log-periodic Antennas I: Mitigating spectral artefacts in SKA1-LOW 21-cm cosmology experiments
• Detecting the 21 cm Forest in the 21 cm Power Spectrum
• Prospects for measuring dark energy with 21 cm intensity mapping experiments
• The HERA-19 Commissioning Array: Direction Dependent Effects
• The impact of non-Gaussianity on the Epoch of Reionization parameter forecast using 21-cm power spectrum measurements
• Statistical recovery of 21cm visibilities and their power spectra with Gaussian constrained realisations and Gibbs sampling
• The Impact of Beam Variations on Power Spectrum Estimation for 21-cm Cosmology I: Simulations of Foreground Contamination for HERA
• General Modified Gravity With 21cm Intensity Mapping: Simulations and Forecast
• The bispectrum and 21cm foregrounds during the Epoch of Reionization
• Small-scale primordial fluctuations in the 21cm Dark Ages signal
• Statistical analysis of the causes of excess variance in the 21 cm signal power spectra obtained with the Low-Frequency Array
• Reionisation & Cosmic Dawn Astrophysics from the Square Kilometre Array: Impact of Observing Strategies
• An Effective Bias Expansion for 21 cm Cosmology in Redshift Space
• Synergies between radio, optical and microwave observations at high redshift
• Anatomy of Cosmic Tidal Reconstruction
• Delay Spectrum with Phase-Tracking Arrays: Extracting the HI power spectrum from the Epoch of Reionization
• Fundamental uncertainty levels of 21cm power spectra from a delay analysis
• The Hydrogen Epoch of Reionization Array Dish III: Measuring Chromaticity of Prototype Element with Reflectometry
• Late-time vacuum phase transitions: Connecting sub-eV scale physics with cosmological structure formation
• Evidence of Ultra-faint Radio Frequency Interference in Deep 21~cm Epoch of Reionization Power Spectra with the Murchison Widefield Array
• How informative are summaries of the cosmic 21-cm signal?
• Beamforming Errors in Murchison Widefield Array Phased Array Antennas and their effects on Epoch of Reionization Science
• Constraining coupled quintessence with the 21cm signal
• Methods of Error Estimation for Delay Power Spectra in $21\text{cm}$ Cosmology
• 21cmFirstCLASS I. Cosmological tool for $\Lambda$CDM and beyond
• Cosmic Variance of the 21-cm Global Signal
• Observing the Reionization : Effect of Calibration and Position Errors on Realistic Observation Conditions
• Quantifying EoR delay spectrum contamination from diffuse radio emission
• Identifying Ionized Regions in Noisy Redshifted 21 cm Data Sets
• Comparison of observing modes for statistical estimation of the 21cm signal from the Epoch of Reionisation
• Detecting the non-Gaussianity of the 21-cm signal during reionisation with the Wavelet Scattering Transform
• Variations in fundamental constants at the cosmic dawn
• Calibration Requirements for Epoch of Reionization 21-cm signal observations -- I. Effect of time-correlated gains
• The Impact of Realistic Foreground and Instrument Models on 21cm Epoch of Reionization Experiments
• Optical depth to reionization from perturbative 21cm clustering
• Impact of instrument and data characteristics in the interferometric reconstruction of the 21 cm power spectrum
• Detecting the HI Power Spectrum in the Post-Reionization Universe with SKA-Low
• Forecasts and Statistical Insights for Line Intensity Mapping Cross-Correlations: A Case Study with 21cm x [CII]
• Beyond the horizon: Quantifying the full sky foreground wedge in the cylindrical power spectrum
• Detectability of 21cm-signal during the Epoch of Reionization with 21cm-Lyman-α emitter cross-correlation. II. Foreground contamination
• Emulation of the Cosmic Dawn 21-cm Power Spectrum and Classification of Excess Radio Models Using an Artificial Neural Network
• Towards 21-cm Intensity Mapping at $z=2.28$ with uGMRT using the Tapered Gridded Estimator I: Foreground Avoidance
• The Role of the Instrumental Response in 21 cm EoR Power Spectrum Gridding Analyses
• Generating extremely large-volume reionisation simulations
• A partial inventory of observational anisotropies in single-dish line-intensity mapping
• Statistical Detection of IGM Structures during Cosmic Reionization using Absorption of the Redshifted 21 cm line by HI against Compact Background Radio Sources
• Sensitivity of the Hydrogen Epoch of Reionization Array and its Build-out Stages to One-point Statistics from Redshifted 21 cm Observations
• Ionospheric Attenuation of Polarized Foregrounds in 21 cm Epoch of Reionization Measurements: A Demonstration for the HERA Experiment
• HI intensity mapping with the MIGHTEE survey: power spectrum estimates
• Investigating the Contribution of Extended Radio Sources to the Epoch of Reionisation Power Spectrum
• Simulated foreground predictions for HI at z = 3.35 with the Ooty Wide Field Array: I. Instrument and the foregrounds
• A galaxy-free phenomenological model for the 21-cm power spectrum during reionization
• HI intensity mapping with MeerKAT: forecast for delay power spectrum measurement using interferometer mode
• Degree-Scale Galactic Radio Emission at 122 MHz around the North Celestial Pole with LOFAR-AARTFAAC
• Transient RFI environment of LOFAR-LBA at 72-75 MHz: Impact on ultra-widefield AARTFAAC Cosmic Explorer observations of the redshifted 21-cm signal
• Towards $21$-cm intensity mapping at $z=2.28$ with uGMRT using the tapered gridded estimator III: Foreground removal
• Improved upper limits on the 21-cm signal power spectrum at $z=17.0$ and $z=20.3$ from an optimal field observed with NenuFAR
• The Tracking Tapered Gridded Estimator for the 21-cm power spectrum from MWA drift scan observations I: Validation and preliminary results
• Detection of Cosmic Structures using the Bispectrum Phase. I. Mathematical Foundations
• Contribution of Radio Halos to the Foreground for SKA EoR Experiments
• Estimating the Feasibility of 21cm-Ly$\alpha$ Synergies using the Hydrogen Epoch of Reionization Array
• Subtracting the kinetic Sunyaev-Zeldovich effect from the cosmic microwave background with surveys of large-scale structure
• The Impact of Tandem Redundant/Sky-Based Calibration in MWA Phase II Data Analysis
• Ionospheric contributions to the excess power in high-redshift 21-cm power-spectrum observations with LOFAR
• 21-cm foreground removal using AI and frequency-difference technique
• Square Kilometre Array Science Data Challenge 3a: foreground removal for an EoR experiment
• Spectral modelling of Cygnus A between 110 and 250 MHz. Impact on the LOFAR 21-cm signal power spectrum
• Unlocking Sensitivity for Visibility-based Estimators of the 21 cm Reionization Power Spectrum
• Contribution of Galactic free-free emission to the foreground for EoR signal in SKA experiments
• On the Prospects of Measuring the Cosmic Dawn 21-cm Power Spectrum using the Upgraded Giant Meterwave Radio Telescope (uGMRT)
• Validating a novel angular power spectrum estimator using simulated low frequency radio-interferometric data
• Towards $21$-cm intensity mapping at $z=2.28$ with uGMRT using the tapered gridded estimator II: Cross-polarization power spectrum
• Calibration requirements for Epoch of Reionization 21-cm signal observations -- II. Analytical estimation of the bias and variance with time-correlated residual gains
• Delay-Weighted Calibration: Precision Calibration for 21 cm Cosmology with Resilience to Sky Model Error
• Why and When to Expect Gaussian Error Distributions in Epoch of Reionization 21-cm Power Spectrum Measurements
• First upper limits on the 21-cm signal power spectrum of neutral hydrogen at $z=9.16$ from the LOFAR 3C196 field
• SKATR: A Self-Supervised Summary Transformer for SKA
• A Comparative Analysis To Deal With Missing Spectral Information Caused By RFI In Cosmological HI 21CM Observations
• Measuring the reionization 21 cm fluctuations using clustering wedges
• Study of systematics effects on the Cross Power Spectrum of 21 cm Line and Cosmic Microwave Background using Murchison Widefield Array Data
• Pre-selection of the Candidate Fields for Deep Imaging of the Epoch of Reionization with SKA1-Low
• Simulated Predictions for HI at $z=3.35$ with the Ooty Wide Field Array (OWFA) -- II: Foreground Avoidance
• The Effect of Interplanetary Scintillation on Epoch of Reionisation Power Spectra
• Measurements of one-point statistics in 21 cm intensity maps via foreground avoidance strategy
• Aliasing from Galactic Plane Setting in Widefield Radio Interferometry
• Sensitivity of Bayesian 21 cm power spectrum estimation to foreground model errors
• Elucidating Dark Energy with Future 21 cm Observations at the Epoch of Reionization
• A Differentiable, End-to-End Forward Model for 21 cm Cosmology: Estimating the Foreground, Instrument, and Signal Joint Posterior
• Linear Polarization of the 21 cm Line from the Epoch of Reionization
• Field-level Reconstruction from Foreground-Contaminated 21-cm Maps
• HI Intensity Mapping with the MIGHTEE Survey: First Results of the HI Power Spectrum
• 21 cm Intensity Mapping with the DSA-2000
• Prospects for cosmological research with the FAST array: 21-cm intensity mapping survey observation strategies
• Reconstructing the Long-wavelength Matter Density Fluctuation Modes from the Scalar-Type Clustering Fossils
• Impact of Calibration and Position Errors on Astrophysical Parameters of the HI 21cm Signal
• Exploring One-point Statistics in HERA Phase I Data: Effects of Foregrounds and Systematics on Measuring One-Point Statistics
• Synthetic Observations with the Square Kilometre Array (SKA) -- development towards an end-to-end pipeline
• Primary Beam Chromaticity in HIRAX: I. Characterization from Simulations and Power Spectrum Implications
• Extracting the Epoch of Reionization Signal with 3D U-Net Neural Networks Using Data-driven Systematic Effect Model
• The impact of lunar topography on the 21-cm power spectrum for grid-based arrays : Insights for the Dark-ages EXplorer (DEX)
• Robust Foregrounds Removal for 21-cm Experiments
• A Monte Carlo Implementation of Galactic Free-Free Emission for the EoR Foreground Models
• Operational Non-identifiability of Single-epoch Low-rank RFI Mitigation: Controlled Failure-mode Analysis and HERA Evidence
• Seeing Wiggles without Seeing Wiggles: BAO Recovery in 21 cm Intensity Mapping with Deep Learning
• Beyond the Power Spectrum: A New Framework for Non-Stationary Fields with Applications to Light-Cone Effects in Line Intensity Mapping
• Testing the growth of cosmic structures during the Dark Ages
• Mitigating incoherent excess variance in high-redshift 21 cm observations with multi-output cross-Gaussian process regression
• The Correlation Calibration of PAPER-64 data
• Bayes-SCF: A Bayesian filter to mitigate foreground leakage in the 21-cm power spectrum
• Power spectrum multipoles and clustering wedges during the Epoch of Reionization
• Mitigating gain calibration errors from EoR observations with SKA1-Low AA*