Statistical recovery of 21cm visibilities and their power spectra with Gaussian constrained realisations and Gibbs sampling
arXiv:2211.05088 · doi:10.3847/1538-4365/acc324
Abstract
Radio interferometers designed to probe the 21cm signal from Cosmic Dawn and the Epoch of Reionisation must contend with systematic effects that make it difficult to achieve sufficient dynamic range to separate the 21cm signal from foreground emission and other effects. For instance, the instrument's chromatic response modulates the otherwise spectrally smooth foregrounds, making them difficult to model, while a significant fraction of the data must be excised due to the presence of radio frequency interference (RFI), leaving gaps in the data. Errors in modelling the (modulated and gappy) foregrounds can easily generate spurious contamination of what should otherwise be 21cm signal-dominated modes. Various approaches have been developed to mitigate these issues by (e.g.) using non-parametric reconstruction of the foregrounds, in-painting the gaps, and weighting the data to reduce the level of contamination. We present a Bayesian statistical method that combines these approaches, using the coupled techniques of Gaussian constrained realisations (GCR) and Gibbs sampling. This provides a way of drawing samples from the joint posterior distribution of the 21cm signal modes and their power spectrum in the presence of gappy data and an uncertain foreground model in a computationally scalable manner. The data are weighted by an inverse covariance matrix that is estimated as part of the inference, along with a foreground model that can then be marginalised over. We demonstrate the application of this technique on a simulated HERA-like delay spectrum analysis, comparing three different approaches for accounting for the foreground components.
arXiv commentUpdated to match accepted version. Note minor changes to power spectrum plots due to a small bugfix
References in corpus (61)
- SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
- The NumPy array: a structure for efficient numerical computation
- HEALPix -- a Framework for High Resolution Discretization, and Fast Analysis of Data Distributed on the Sphere
- LOFAR: The LOw-Frequency ARray
- Cosmology at Low Frequencies: The 21 cm Transition and the High-Redshift Universe
- The Murchison Widefield Array: the Square Kilometre Array Precursor at low radio frequencies
- 21-cm cosmology
- 21-cm Tomography of the Intergalactic Medium at High Redshift
- Hydrogen Epoch of Reionization Array (HERA)
- GaLactic and Extragalactic All-sky Murchison Widefield Array (GLEAM) survey I: A low-frequency extragalactic catalogue
- Reionization and Cosmology with 21 cm Fluctuations
- The Precision Array for Probing the Epoch of Reionization: 8 Station Results
- Bright Source Subtraction Requirements For Redshifted 21 cm Measurements
- A simulation calibrated limit on the HI power spectrum from the GMRT Epoch of Reionization experiment
- Four Fundamental Foreground Power Spectrum Shapes for 21 cm Cosmology Observations
- Improved upper limits on the 21-cm signal power spectrum of neutral hydrogen at from LOFAR
- Joint Bayesian component separation and CMB power spectrum estimation
- Multifrequency analysis of 21 cm fluctuations from the Era of Reionization
- Upper limits on the 21-cm Epoch of Reionization power spectrum from one night with LOFAR
- The Epoch of Reionization Window: I. Mathematical Formalism
- The Phase II Murchison Widefield Array: Design Overview
- Deep multi-redshift limits on Epoch of Reionisation 21cm Power Spectra from Four Seasons of Murchison Widefield Array Observations
- Global, Exact Cosmic Microwave Background Data Analysis Using Gibbs Sampling
- Radio Foregrounds for the 21cm Tomography of the Neutral Intergalactic Medium at High Redshifts
- Systematic effects in LOFAR data: A unified calibration strategy
- The Epoch of Reionization Window: II. Statistical Methods for Foreground Wedge Reduction
- First Results from HERA Phase I: Upper Limits on the Epoch of Reionization 21 cm Power Spectrum
- Calibration Requirements for Detecting the 21 cm Epoch of Reionization Power Spectrum and Implications for the SKA
- Foreground Contamination in Interferometric Measurements of the Redshifted 21 cm Power Spectrum
- Opening the 21cm EoR Window: Measurements of Foreground Isolation with PAPER
- Foregrounds in Wide-Field Redshifted 21 cm Power Spectra
- A simplified, lossless re-analysis of PAPER-64
- Improving the Epoch of Reionization Power Spectrum Results from Murchison Widefield Array Season 1 Observations
- Improving Foreground Subtraction in Statistical Observations of 21 cm Emission from the Epoch of Reionization
- CHIPS: The Cosmological HI Power Spectrum Estimator
- Foregrounds for redshifted 21 cm studies of reionization: GMRT 153 MHz observations
- The Impact of Modeling Errors on Interferometer Calibration for 21 cm Power Spectra
- Systematic biases in low frequency radio interferometric data due to calibration: the LOFAR EoR case
- First Limits on the 21 cm Power Spectrum during the Epoch of X-ray heating
- First Season MWA Phase II EoR Power Spectrum Results at Redshift 7
- Fundamental Limitations on the Calibration of Redundant 21 cm Cosmology Instruments and Implications for HERA and the SKA
- Calibration of Low-Frequency, Wide-Field Radio Interferometers Using Delay/Delay-Rate Filtering
- Detection of Cosmological 21 cm Emission with the Canadian Hydrogen Intensity Mapping Experiment
- Mitigating Internal Instrument Coupling for 21 cm Cosmology I: Temporal and Spectral Modeling in Simulations
- Mitigating the Effects of Antenna-to-Antenna Variation on Redundant-Baseline Calibration for 21 cm Cosmology
- The impact of interference excision on 21-cm Epoch of Reionization power spectrum analyses
- Gaussian Process Foreground Subtraction and Power Spectrum Estimation for 21 cm Cosmology
- A 21-cm power spectrum at 48 MHz, using the Owens Valley Long Wavelength Array
- Understanding the HERA Phase I receiver system with simulations and its impact on the detectability of the EoR delay power spectrum
- DAYENU: A Simple Filter of Smooth Foregrounds for Intensity Mapping Power Spectra
- The Bias and Uncertainty of Redundant and Sky-Based Calibration under Realistic Sky and Telescope Conditions
- Quantifying Suppression of the Cosmological 21-cm Signal due to Direction Dependent Gain Calibration in Radio Interferometers
- Wide-field LOFAR-LBA power-spectra analyses: Impact of calibration, polarization leakage and ionosphere
- Patterns of primary beam non-redundancy in close-packed 21 cm array observations
- Calibration and 21-cm Power Spectrum Estimation in the Presence of Antenna Beam Variations
- Foreground modelling via Gaussian process regression: an application to HERA data
- Quantifying Excess Power from Radio Frequency Interference in Epoch of Reionization Measurements
- Exploring the consequences of chromatic data excision in 21-cm Epoch of Reionization power spectrum observations
- Characterization Of Inpaint Residuals In Interferometric Measurements of the Epoch Of Reionization
- A Comparative Analysis To Deal With Missing Spectral Information Caused By RFI In Cosmological HI 21CM Observations
- A Clustered Extragalactic Foreground Model for the EoR
Cited by in corpus (10)
- Bayesian approach to radio frequency interference mitigation
- Towards -cm intensity mapping at with uGMRT using the tapered gridded estimator III: Foreground removal
- The Tracking Tapered Gridded Estimator for the 21-cm power spectrum from MWA drift scan observations I: Validation and preliminary results
- Towards -cm intensity mapping at with uGMRT using the tapered gridded estimator -- IV. Wideband analysis
- Sensitivity of Bayesian 21 cm power spectrum estimation to foreground model errors
- A Differentiable, End-to-End Forward Model for 21 cm Cosmology: Estimating the Foreground, Instrument, and Signal Joint Posterior
- Statistical estimation of full-sky radio maps from 21cm array visibility data using Gaussian constrained realizations
- 21 cm Intensity Mapping with the DSA-2000
- Foreground removal and angular power spectrum estimation of 21 cm signal using harmonic space ILC method
- Bayes-SCF: A Bayesian filter to mitigate foreground leakage in the 21-cm power spectrum