The impact of interference excision on 21-cm Epoch of Reionization power spectrum analyses

Abstract

We investigate the implications of interference detection for experiments that are pursuing a detection of the redshifted 21-cm signals from the Epoch of Reionization. Interference detection causes samples to be sporadically flagged and rejected. As a necessity to reduce the data volume, flagged samples are typically (implicitly) interpolated during time or frequency averaging or uv-gridding. This so-far unexplored systematic biases the 21-cm power spectrum, and it is important to understand this bias for current 21-cm experiments as well as the upcoming SKA Epoch of Reionization experiment. We analyse simulated data using power spectrum analysis and Gaussian process regression. We find that the combination of flagging and averaging causes tiny spectral fluctuations, resulting in `flagging excess power'. This excess power does not substantially average down over time and, without extra mitigation techniques, can exceed the power of realistic models of the 21-cm reionization signals in LOFAR observations. We mitigate the bias by i) implementing a novel way to average data using a Gaussian-weighted interpolation scheme; ii) using unitary instead of inverse-variance weighting of visibilities; and iii) using low-resolution forward modelling of the data. After these modifications, which have been integrated in the LOFAR EoR processing pipeline, the excess power reduces by approximately three orders of magnitude, and is no longer preventing a detection of the 21-cm signals.

11 pages, 8 figures, accepted for publication in MNRAS

References in corpus (20)

• Cosmology at Low Frequencies: The 21 cm Transition and the High-Redshift Universe
• WSClean: an implementation of a fast, generic wide-field imager for radio astronomy
• GaLactic and Extragalactic All-sky Murchison Widefield Array (GLEAM) survey I: A low-frequency extragalactic catalogue
• Post-correlation radio frequency interference classification methods
• Foreground simulations for the LOFAR - Epoch of Reionization Experiment
• 21CMMC: an MCMC analysis tool enabling astrophysical parameter studies of the cosmic 21 cm signal
• Extragalactic Peaked-Spectrum Radio Sources at Low Frequencies
• First Season MWA EoR Power Spectrum Results at Redshift 7
• The low-frequency environment of the Murchison Widefield Array: radio-frequency interference analysis and mitigation
• The Scale of the Problem : Recovering Images of Reionization with GMCA
• Non-parametric foreground subtraction for 21cm epoch of reionization experiments
• The LOFAR radio environment
• Will point sources spoil 21 cm tomography?
• Compression of interferometric radio-astronomical data
• A High Reliability Survey of Discrete Epoch of Reionization Foreground Sources in the MWA EoR0 Field
• Automated Editing of Radio Interferometer Data with Pieflag
• A high resolution foreground model for the MWA EoR1 field: model and implications for EoR power spectrum analysis
• RFI detection by automated feature extraction and statistical analysis
• Deconvolving the Wedge: Maximum-Likelihood Power Spectra via Spherical-Wave Visibility Modeling
• Building models for extended radio sources: implications for Epoch of Reionisation science

Cited by in corpus (42)

• Improved upper limits on the 21-cm signal power spectrum of neutral hydrogen at $\mathbf{z}\approx 9.1$ from LOFAR
• First Results from HERA Phase I: Upper Limits on the Epoch of Reionization 21 cm Power Spectrum
• Improving the Epoch of Reionization Power Spectrum Results from Murchison Widefield Array Season 1 Observations
• Mitigating Internal Instrument Coupling II: A Method Demonstration with the Hydrogen Epoch of Reionization Array
• A new MWA limit on the 21 cm Power Spectrum at Redshifts $\sim$ 13 $-$ 17
• First upper limits on the 21 cm signal power spectrum from cosmic dawn from one night of observations with NenuFAR
• Comparing Foreground Removal Techniques for Recovery of the LOFAR-EoR 21cm Power Spectrum
• Optimizing Sparse RFI Prediction using Deep Learning
• The FHD/$\mathbf{\epsilon }$ppsilon Epoch of Reionization Power Spectrum Pipeline
• Gaussian Process Regression for foreground removal in HI intensity mapping experiments
• New EoR Power Spectrum Limits From MWA Phase II Using the Delay Spectrum Method and Novel Systematic Rejection
• Deeper multi-redshift upper limits on the Epoch of Reionization 21-cm signal power spectrum from LOFAR between z=8.3 and z=10.1
• Validation of the HERA Phase I Epoch of Reionization 21 cm Power Spectrum Software Pipeline
• Assessing the impact of two independent direction-dependent calibration algorithms on the LOFAR 21-cm signal power spectrum
• Statistical recovery of 21cm visibilities and their power spectra with Gaussian constrained realisations and Gibbs sampling
• Statistical analysis of the causes of excess variance in the 21 cm signal power spectra obtained with the Low-Frequency Array
• Evidence of Ultra-faint Radio Frequency Interference in Deep 21~cm Epoch of Reionization Power Spectra with the Murchison Widefield Array
• Exploring the cosmic dawn and epoch of reionization with 21cm line
• Statistical recovery of the BAO scale from multipoles of the beam-convolved 21cm correlation function
• The Role of the Instrumental Response in 21 cm EoR Power Spectrum Gridding Analyses
• Exploring the consequences of chromatic data excision in 21-cm Epoch of Reionization power spectrum observations
• Constraints on the state of the IGM at $z\sim 8-10$ using redshifted 21-cm observations with LOFAR
• Measurement of the Anisotropy Power Spectrum of the Radio Synchrotron Background
• SKA-Low Intensity Mapping Pathfinder Updates: Deeper 21 cm Power Spectrum Limits from Improved Analysis Frameworks
• Transient RFI environment of LOFAR-LBA at 72-75 MHz: Impact on ultra-widefield AARTFAAC Cosmic Explorer observations of the redshifted 21-cm signal
• Characterization Of Inpaint Residuals In Interferometric Measurements of the Epoch Of Reionization
• Ionospheric contributions to the excess power in high-redshift 21-cm power-spectrum observations with LOFAR
• Spectral modelling of Cygnus A between 110 and 250 MHz. Impact on the LOFAR 21-cm signal power spectrum
• Why and When to Expect Gaussian Error Distributions in Epoch of Reionization 21-cm Power Spectrum Measurements
• First upper limits on the 21-cm signal power spectrum of neutral hydrogen at $z=9.16$ from the LOFAR 3C196 field
• Diffuse Sources, Clustering and the Excess Anisotropy of the Radio Synchrotron Background
• Sensitivity of Bayesian 21 cm power spectrum estimation to foreground model errors
• A Comparative Analysis To Deal With Missing Spectral Information Caused By RFI In Cosmological HI 21CM Observations
• The FHD Polarized Imaging Pipeline: A New Approach to Widefield Interferometric Polarimetry
• Aliasing from Galactic Plane Setting in Widefield Radio Interferometry
• 21 cm Intensity Mapping with the DSA-2000
• Synthetic Observations with the Square Kilometre Array (SKA) -- development towards an end-to-end pipeline
• Epoch of Reionization Power Spectrum Limits from Murchison Widefield Array Data Targeted at EoR1 Field
• TABASCAL: Removing multi-satellite interference from radio interferometry observations
• The impact of lunar topography on the 21-cm power spectrum for grid-based arrays : Insights for the Dark-ages EXplorer (DEX)
• Mitigating incoherent excess variance in high-redshift 21 cm observations with multi-output cross-Gaussian process regression
• An SBC-based controller and processor for the laboratory model of PRATUSH Digital Receiver