A Comparative Analysis To Deal With Missing Spectral Information Caused By RFI In Cosmological HI 21CM Observations

Abstract

We investigate the effect of radio-frequency interference (RFI) excision in estimating the cosmological \hi\ 21 cm power spectrum. Flagging of RFI-contaminated channels results in a non-uniform sampling of the instrumental bandpass response. Hence, the Fourier transformation (FT) of visibilities from frequency to delay domain contaminates the higher foreground-free delay modes, and separating the spectrally fluctuating \hi\ signal from spectrally smooth foregrounds becomes challenging. We have done a comparative analysis between two algorithms, one-dimensional CLEAN and Least Square Spectral Analysis (LSSA), which have been used widely to solve this issue in the literature. We test these algorithms using the simulated SKA-1 low observations in the presence of different RFI flagging scenarios. We find that in the presence of random flagging of data, both algorithms perform well and can mitigate the foreground leakage issue. But, CLEAN fails to restrict the foreground leakage in the presence of periodic and periodic plus broadband RFI flagging and gives an extra bias to the estimated power spectrum. However, LSSA can restrict the foreground leakage for these RFI flagging scenarios and gives an unbiased estimate of the \hi\ 21 cm power spectrum. We have also applied these algorithms to the upgraded GMRT observation and found that both CLEAN and LSSA give consistent results in the presence of realistic random flagging scenarios for this observed data set. This comparative analysis demonstrates the effectiveness and robustness of these two algorithms in estimating the \hi\ 21 cm power spectrum from the data set affected by different RFI scenarios.

arXiv commentaccepted for publication in APJ

References in corpus (68)

• SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
• Array Programming with NumPy
• Astropy: A Community Python Package for Astronomy
• The NumPy array: a structure for efficient numerical computation
• The Astropy Project: Building an inclusive, open-science project and status of the v2.0 core package
• LOFAR: The LOw-Frequency ARray
• Cosmology at Low Frequencies: The 21 cm Transition and the High-Redshift Universe
• 21-cm cosmology
• WSClean: an implementation of a fast, generic wide-field imager for radio astronomy
• 21-cm Tomography of the Intergalactic Medium at High Redshift
• Hydrogen Epoch of Reionization Array (HERA)
• A Full-Sky H-alpha Template for Microwave Foreground Prediction
• The Precision Array for Probing the Epoch of Reionization: 8 Station Results
• 21 Centimeter Fluctuations from Cosmic Gas at High Redshifts
• How to measure CMB power spectra without losing information
• A morphological algorithm for improving radio-frequency interference detection
• Bright Source Subtraction Requirements For Redshifted 21 cm Measurements
• A semi-empirical simulation of the extragalactic radio continuum sky for next generation radio telescopes
• Late-time cosmology with 21cm intensity mapping experiments
• A Per-Baseline, Delay-Spectrum Technique for Accessing the 21cm Cosmic Reionization Signature
• Four Fundamental Foreground Power Spectrum Shapes for 21 cm Cosmology Observations
• Improved upper limits on the 21-cm signal power spectrum of neutral hydrogen at $\mathbf{z}\approx 9.1$ from LOFAR
• Cosmology with Phase 1 of the Square Kilometre Array; Red Book 2018: Technical specifications and performance forecasts
• Upper limits on the 21-cm Epoch of Reionization power spectrum from one night with LOFAR
• New Limits on 21cm EoR From PAPER-32 Consistent with an X-Ray Heated IGM at z=7.7
• Foreground simulations for the LOFAR - Epoch of Reionization Experiment
• Toward Epoch of Reionization Measurements with Wide-Field Radio Observations
• Imaging the Epoch of Reionization: limitations from foreground confusion and imaging algorithms
• First Season MWA EoR Power Spectrum Results at Redshift 7
• A study of fundamental limitations to statistical detection of redshifted HI from the epoch of reionization
• On using visibility correlations to probe the HI distribution from the dark ages to the present epoch I: Formalism and the expected signal
• The Cosmic Dawn and Epoch of Reionization with the Square Kilometre Array
• Initial deep LOFAR observations of Epoch of Reionization windows: I. The North Celestial Pole
• Improving the Epoch of Reionization Power Spectrum Results from Murchison Widefield Array Season 1 Observations
• A simplified, lossless re-analysis of PAPER-64
• Towards a model of full-sky Galactic synchrotron intensity and linear polarisation: a re-analysis of the Parkes data
• The Scale of the Problem : Recovering Images of Reionization with GMCA
• CHIPS: The Cosmological HI Power Spectrum Estimator
• Statistical 21-cm Signal Separation via Gaussian Process Regression Analysis
• Empirical Covariance Modeling for 21 cm Power Spectrum Estimation: A Method Demonstration and New Limits from Early Murchison Widefield Array 128-Tile Data
• Foregrounds for redshifted 21 cm studies of reionization: GMRT 153 MHz observations
• Power Spectrum of the density of cold atomic gas in the Galaxy towards Cas A and Cygnus A
• Characterizing Foreground for redshifted 21-cm radiation: 150 MHz GMRT observations
• The 21 centimeter emission from the reionization epoch: extended and point source foregrounds
• The Evolution of 21-cm Structure (EOS): public, large-scale simulations of Cosmic Dawn and Reionization
• The first power spectrum limit on the 21-cm signal of neutral hydrogen during the Cosmic Dawn at z=20-25 from LOFAR
• Non-parametric foreground subtraction for 21cm epoch of reionization experiments
• HI Fluctuations at Large Redshifts: I--Visibility correlation
• Calibration of Low-Frequency, Wide-Field Radio Interferometers Using Delay/Delay-Rate Filtering
• Fluctuations in 21cm Emission After Reionization
• Mitigating Internal Instrument Coupling for 21 cm Cosmology I: Temporal and Spectral Modeling in Simulations
• Understanding the Diversity of 21 cm Cosmology Analyses
• Absolving the SSINS of Precision Interferometric Radio Data: A New Technique for Mitigating Faint Radio Frequency Interference
• The impact of interference excision on 21-cm Epoch of Reionization power spectrum analyses
• Comparing Redundant and Sky Model Based Interferometric Calibration: A First Look with Phase II of the MWA
• DAYENU: A Simple Filter of Smooth Foregrounds for Intensity Mapping Power Spectra
• The visibility based Tapered Gridded Estimator (TGE) for the redshifted 21-cm power spectrum
• Separating the EoR Signal with a Convolutional Denoising Autoencoder: A Deep-learning-based Method
• Improved 21 cm Epoch Of Reionization Power Spectrum Measurements with a Hybrid Foreground Subtraction and Avoidance Technique
• Detailed study of ELAIS N1 field with the uGMRT -- II. Source Properties and Spectral Variation Of Foreground Power Spectrum from 300-500 MHz Observations
• HI Fluctuations at Large Redshifts: II - the Signal Expected for GMRT
• A high resolution foreground model for the MWA EoR1 field: model and implications for EoR power spectrum analysis
• Analysing the impact of far-out side-lobes on the imaging performance of the SKA-LOW telescope
• Demonstrating the Tapered Gridded Estimator (TGE) for the Cosmological HI 21-cm Power Spectrum using $150\mathrm{MHz}$ GMRT observations
• A Digital-Receiver for the Murchison Widefield Array
• A Tapered Gridded Estimator (TGE) for the Multi-Frequency Angular Power Spectrum (MAPS) and the Cosmological HI 21-cm Power Spectrum
• First multi-redshift limits on post-Epoch of Reionization (post-EoR) 21 cm signal from z = 1.96 - 3.58 using uGMRT
• How to Identify and Separate Bright Galaxy Clusters from the Low-frequency Radio Sky?

Cited by in corpus (4)

• Statistical recovery of 21cm visibilities and their power spectra with Gaussian constrained realisations and Gibbs sampling
• Towards $21$-cm intensity mapping at $z=2.28$ with uGMRT using the tapered gridded estimator II: Cross-polarization power spectrum
• 21 cm Intensity Mapping with the DSA-2000
• Synthetic Observations with the Square Kilometre Array (SKA) -- development towards an end-to-end pipeline