Systematic biases in low frequency radio interferometric data due to calibration: the LOFAR EoR case

Abstract

The redshifted 21 cm line of neutral hydrogen is a promising probe of the Epoch of Reionization (EoR). However, its detection requires a thorough understanding and control of the systematic errors. We study two systematic biases observed in the LOFAR EoR residual data after calibration and subtraction of bright discrete foreground sources. The first effect is a suppression in the diffuse foregrounds, which could potentially mean a suppression of the 21 cm signal. The second effect is an excess of noise beyond the thermal noise. The excess noise shows fluctuations on small frequency scales, and hence it can not be easily removed by foreground removal or avoidance methods. Our analysis suggests that sidelobes of residual sources due to the chromatic point spread function and ionospheric scintillation can not be the dominant causes of the excess noise. Rather, both the suppression of diffuse foregrounds and the excess noise can occur due to calibration with an incomplete sky model containing predominantly bright discrete sources. We show that calibrating only on bright sources can cause suppression of other signals and introduce an excess noise in the data. The levels of the suppression and excess noise depend on the relative flux of sources which are not included in the model with respect to the flux of modeled sources. We discuss possible solutions such as using only long baselines to calibrate the interferometric gain solutions as well as simultaneous multi-frequency calibration along with their benefits and shortcomings.

arXiv commentSubmitted to MNRAS, 14 pages, 11 figures

References in corpus (49)

• Nine-Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Cosmological Parameter Results
• LOFAR: The LOw-Frequency ARray
• The Murchison Widefield Array: the Square Kilometre Array Precursor at low radio frequencies
• Faraday Rotation Measure Synthesis
• The Precision Array for Probing the Epoch of Reionization: 8 Station Results
• A morphological algorithm for improving radio-frequency interference detection
• Bright Source Subtraction Requirements For Redshifted 21 cm Measurements
• Reionization and the Cosmic Dawn with the Square Kilometre Array
• A simulation calibrated limit on the HI power spectrum from the GMRT Epoch of Reionization experiment
• A Per-Baseline, Delay-Spectrum Technique for Accessing the 21cm Cosmic Reionization Signature
• Science with the Murchison Widefield Array
• Four Fundamental Foreground Power Spectrum Shapes for 21 cm Cosmology Observations
• Post-correlation radio frequency interference classification methods
• Foreground simulations for the LOFAR - Epoch of Reionization Experiment
• PAPER-64 Constraints on Reionization: The 21cm Power Spectrum at z=8.4
• Imaging the Epoch of Reionization: limitations from foreground confusion and imaging algorithms
• Radio Foregrounds for the 21cm Tomography of the Neutral Intergalactic Medium at High Redshifts
• Calibration Requirements for Detecting the 21 cm Epoch of Reionization Power Spectrum and Implications for the SKA
• Real-Time Calibration of the Murchison Widefield Array
• Foreground Removal using FastICA: A Showcase of LOFAR-EoR
• Initial deep LOFAR observations of Epoch of Reionization windows: I. The North Celestial Pole
• Probing Ionospheric Structures using the LOFAR radio telescope
• Realistic Simulations of the Galactic Polarized Foreground: Consequences for 21-cm Reionization Detection Experiments
• The Scale of the Problem : Recovering Images of Reionization with GMCA
• Foregrounds for 21cm Observations of Neutral Gas at High Redshift
• Radio Interferometric Calibration Using The SAGE Algorithm
• CHIPS: The Cosmological HI Power Spectrum Estimator
• Empirical Covariance Modeling for 21 cm Power Spectrum Estimation: A Method Demonstration and New Limits from Early Murchison Widefield Array 128-Tile Data
• The 21 centimeter emission from the reionization epoch: extended and point source foregrounds
• Power spectrum extraction for redshifted 21-cm epoch of reionization experiments: the LOFAR case
• First Limits on the 21 cm Power Spectrum during the Epoch of X-ray heating
• Multisource Self-calibration for Sensor Arrays
• Non-parametric foreground subtraction for 21cm epoch of reionization experiments
• MITEoR: A Scalable Interferometer for Precision 21 cm Cosmology
• Distributed Radio Interferometric Calibration
• Linear polarization structures in LOFAR observations of the interstellar medium in the 3C196 field
• Initial LOFAR observations of Epoch of Reionization windows: II. Diffuse polarized emission in the ELAIS-N1 field
• Spectral calibration requirements of radio interferometers for Epoch of Reionisation science with the SKA
• Constraining the epoch of reionization with the variance statistic: simulations of the LOFAR case
• Calibration artefacts in radio interferometry. I. Ghost sources in WSRT data
• Imaging neutral hydrogen on large-scales during the Epoch of Reionization with LOFAR
• Scintillation noise power spectrum and its impact on high redshift 21-cm observations
• Scintillation noise in widefield radio interferometry
• Robust Radio Interferometric Calibration Using the t-Distribution
• Free-Free Emission at Low Radio Frequencies
• Detection of Signals from Cosmic Reionization using Radio Interferometric Signal Processing
• Clustered Calibration: An Improvement to Radio Interferometric Direction Dependent Self-Calibration
• Ionospheric Power-Spectrum Tomography in Radio Interferometry
• Radio Interferometric Calibration via Ordered-Subsets Algorithms: OS-LS and OS-SAGE calibrations

Cited by in corpus (79)

• Improved upper limits on the 21-cm signal power spectrum of neutral hydrogen at $\mathbf{z}\approx 9.1$ from LOFAR
• Upper limits on the 21-cm Epoch of Reionization power spectrum from one night with LOFAR
• The Phase II Murchison Widefield Array: Design Overview
• Data Analysis for Precision 21 cm Cosmology
• Statistical 21-cm Signal Separation via Gaussian Process Regression Analysis
• The Impact of Modeling Errors on Interferometer Calibration for 21 cm Power Spectra
• Emulating Simulations of Cosmic Dawn for 21cm Power Spectrum Constraints on Cosmology, Reionization, and X-ray Heating
• The first power spectrum limit on the 21-cm signal of neutral hydrogen during the Cosmic Dawn at z=20-25 from LOFAR
• First Season MWA Phase II EoR Power Spectrum Results at Redshift 7
• Fundamental Limitations on the Calibration of Redundant 21 cm Cosmology Instruments and Implications for HERA and the SKA
• Characterizing Signal Loss in the 21 cm Reionization Power Spectrum: A Revised Study of PAPER-64
• A new MWA limit on the 21 cm Power Spectrum at Redshifts $\sim$ 13 $-$ 17
• Mitigating the Effects of Antenna-to-Antenna Variation on Redundant-Baseline Calibration for 21 cm Cosmology
• Understanding the Diversity of 21 cm Cosmology Analyses
• The impact of interference excision on 21-cm Epoch of Reionization power spectrum analyses
• Comparing Foreground Removal Techniques for Recovery of the LOFAR-EoR 21cm Power Spectrum
• First upper limits on the 21 cm signal power spectrum from cosmic dawn from one night of observations with NenuFAR
• Comparing Redundant and Sky Model Based Interferometric Calibration: A First Look with Phase II of the MWA
• Spherical Harmonic Analyses of Intensity Mapping Power Spectra
• DAYENU: A Simple Filter of Smooth Foregrounds for Intensity Mapping Power Spectra
• Quantifying Suppression of the Cosmological 21-cm Signal due to Direction Dependent Gain Calibration in Radio Interferometers
• A Unified Calibration Framework for 21 cm Cosmology
• Wide-field LOFAR-LBA power-spectra analyses: Impact of calibration, polarization leakage and ionosphere
• Patterns of primary beam non-redundancy in close-packed 21 cm array observations
• Calibration and 21-cm Power Spectrum Estimation in the Presence of Antenna Beam Variations
• Gridded and direct Epoch of Reionisation bispectrum estimates using the Murchison Widefield Array
• Precision requirements for interferometric gridding in 21-cm power spectrum analysis
• A numerical study of 21-cm signal suppression and noise increase in direction-dependent calibration of LOFAR data
• A high resolution foreground model for the MWA EoR1 field: model and implications for EoR power spectrum analysis
• Foreground modelling via Gaussian process regression: an application to HERA data
• Quantifying Excess Power from Radio Frequency Interference in Epoch of Reionization Measurements
• Deeper multi-redshift upper limits on the Epoch of Reionization 21-cm signal power spectrum from LOFAR between z=8.3 and z=10.1
• A Map of Diffuse Radio Emission at 182 MHz to Enhance Epoch of Reionization Observations in the Southern Hemisphere
• Spectral performance of SKA Log-periodic Antennas I: Mitigating spectral artefacts in SKA1-LOW 21-cm cosmology experiments
• Assessing the impact of two independent direction-dependent calibration algorithms on the LOFAR 21-cm signal power spectrum
• First multi-redshift limits on post-Epoch of Reionization (post-EoR) 21 cm signal from z = 1.96 - 3.58 using uGMRT
• Statistical recovery of 21cm visibilities and their power spectra with Gaussian constrained realisations and Gibbs sampling
• Statistical analysis of the causes of excess variance in the 21 cm signal power spectra obtained with the Low-Frequency Array
• An Improved Statistical Point-Source Foreground Model for the Epoch of Reionization
• Evidence of Ultra-faint Radio Frequency Interference in Deep 21~cm Epoch of Reionization Power Spectra with the Murchison Widefield Array
• Exploring the cosmic dawn and epoch of reionization with 21cm line
• Probing early universe through redshifted 21-cm signal: Modelling and observational challenges
• On the use of temporal filtering for mitigating galactic synchrotron calibration bias in 21 cm reionization observations
• Spectral performance of Square Kilometre Array Antennas II: Calibration performance
• A Bayesian approach to high fidelity interferometric calibration II: demonstration with simulated data
• Calibration Requirements for Epoch of Reionization 21-cm signal observations -- I. Effect of time-correlated gains
• Constraints on the state of the IGM at $z\sim 8-10$ using redshifted 21-cm observations with LOFAR
• The Role of the Instrumental Response in 21 cm EoR Power Spectrum Gridding Analyses
• On the general nature of 21cm-Lyman-$\alpha$ emitters cross-correlations during reionisation
• SKA-Low Intensity Mapping Pathfinder Updates: Deeper 21 cm Power Spectrum Limits from Improved Analysis Frameworks
• Measurement of the Anisotropy Power Spectrum of the Radio Synchrotron Background
• Simulated foreground predictions for HI at z = 3.35 with the Ooty Wide Field Array: I. Instrument and the foregrounds
• Transient RFI environment of LOFAR-LBA at 72-75 MHz: Impact on ultra-widefield AARTFAAC Cosmic Explorer observations of the redshifted 21-cm signal
• Degree-Scale Galactic Radio Emission at 122 MHz around the North Celestial Pole with LOFAR-AARTFAAC
• Improved upper limits on the 21-cm signal power spectrum at $z=17.0$ and $z=20.3$ from an optimal field observed with NenuFAR
• Effects of model incompleteness on the drift-scan calibration of radio telescopes
• Spectral modelling of Cygnus A between 110 and 250 MHz. Impact on the LOFAR 21-cm signal power spectrum
• Ionospheric contributions to the excess power in high-redshift 21-cm power-spectrum observations with LOFAR
• Using the sample variance of 21cm maps as a tracer of the ionisation topology
• Validation Solutions to the Full-Sky Radio Interferometry Measurement Equation for Diffuse Emission
• Calibration requirements for Epoch of Reionization 21-cm signal observations -- II. Analytical estimation of the bias and variance with time-correlated residual gains
• Diffuse radio source candidate in CIZA J1358.9-4750
• First upper limits on the 21-cm signal power spectrum of neutral hydrogen at $z=9.16$ from the LOFAR 3C196 field
• Statistical Performance of Radio Interferometric Calibration
• Aliasing from Galactic Plane Setting in Widefield Radio Interferometry
• Characterizing Beam Errors for Radio Interferometric Observations of Reionization
• Diffuse radio sky models using large scale shapelets
• Field-level Reconstruction from Foreground-Contaminated 21-cm Maps
• Robust direction-dependent gain-calibration of beam-modelling errors far from the target field
• Strategy for mitigation of systematics for EoR experiments with the Murchison Widefield Array
• Synthetic Observations with the Square Kilometre Array (SKA) -- development towards an end-to-end pipeline
• Assessment of ionospheric activity tolerances for Epoch of Reionisation science with the Murchison Widefield Array
• Calibration requirement for Epoch of Reionization 21-cm signal observation -- III. Bias and variance in uGMRT ELAIS-N1 field power spectrum
• Primary Beam Chromaticity in HIRAX: I. Characterization from Simulations and Power Spectrum Implications
• Robust Foregrounds Removal for 21-cm Experiments
• Imaging and Modeling Data from the Hydrogen Epoch of Reionization Array
• CHILES VII: Deep Imaging for the CHILES project, a SKA prototype
• Interpreting the HI 21-cm cosmology maps through Largest Cluster Statistics. Part II. Impact of the realistic foreground and instrumental noise on synthetic SKA1-Low observations
• Removing systematics-induced 21-cm foreground residuals by cross-correlating filtered data