Comparing Foreground Removal Techniques for Recovery of the LOFAR-EoR 21cm Power Spectrum

Abstract

We compare various foreground removal techniques that are being utilised to remove bright foregrounds in various experiments aiming to detect the redshifted 21cm signal of neutral hydrogen from the Epoch of Reionization. In this work, we test the performance of removal techniques (FastICA, GMCA, and GPR) on 10 nights of LOFAR data and investigate the possibility of recovering the latest upper limit on the 21cm signal. Interestingly, we find that GMCA and FastICA reproduce the most recent 2$\sigma$ upper limit of ${\Delta }_{21}^2<$ (73)${}^2$ mK${}^2$ at $k=0.075h{\mathrm{cMpc}}^{-1}$, which resulted from the application of GPR. We also find that FastICA and GMCA begin to deviate from the noise-limit at \textit{k}-scales larger than $\sim 0.1h{\mathrm{cMpc}}^{-1}$. We then replicate the data via simulations to see the source of FastICA and GMCA's limitations, by testing them against various instrumental effects. We find that no single instrumental effect, such as primary beam effects or mode-mixing, can explain the poorer recovery by FastICA and GMCA at larger \textit{k}-scales. We then test scale-independence of FastICA and GMCA, and find that lower \textit{k}-scales can be modelled by a smaller number of independent components. For larger scales ($k\gtrsim 0.1h{\mathrm{cMpc}}^{-1}$), more independent components are needed to fit the foregrounds. We conclude that, the current usage of GPR by the LOFAR collaboration is the appropriate removal technique. It is both robust and less prone to overfitting, with future improvements to GPR's fitting optimisation to yield deeper limits.

arXiv comment15 pages, 11 figures, accepted by MNRAS on 02 November 2020

References in corpus (73)

• Scikit-learn: Machine Learning in Python
• SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
• The NumPy array: a structure for efficient numerical computation
• The Astropy Project: Building an inclusive, open-science project and status of the v2.0 core package
• LOFAR: The LOw-Frequency ARray
• Cosmology at Low Frequencies: The 21 cm Transition and the High-Redshift Universe
• Constraining the Evolution of the Ionizing Background and the Epoch of Reionization with z ~ 6 Quasars II: A Sample of 19 Quasars
• The Murchison Widefield Array: the Square Kilometre Array Precursor at low radio frequencies
• An absorption profile centred at 78 megahertz in the sky-averaged spectrum
• 21-cm cosmology
• WSClean: an implementation of a fast, generic wide-field imager for radio astronomy
• 21cmFAST: A Fast, Semi-Numerical Simulation of the High-Redshift 21-cm Signal
• Hydrogen Epoch of Reionization Array (HERA)
• Reionization and Cosmology with 21 cm Fluctuations
• The First Cosmic Structures and their Effects
• A simulation calibrated limit on the HI power spectrum from the GMRT Epoch of Reionization experiment
• Improved upper limits on the 21-cm signal power spectrum of neutral hydrogen at $\mathbf{z}\approx 9.1$ from LOFAR
• Upper limits on the 21-cm Epoch of Reionization power spectrum from one night with LOFAR
• New Limits on 21cm EoR From PAPER-32 Consistent with an X-Ray Heated IGM at z=7.7
• Foreground simulations for the LOFAR - Epoch of Reionization Experiment
• Concerns about Modelling of the EDGES Data
• Planck intermediate results. XLVII. Planck constraints on reionization history
• Deep multi-redshift limits on Epoch of Reionisation 21cm Power Spectra from Four Seasons of Murchison Widefield Array Observations
• The GMRT-EoR Experiment: A new upper limit on the neutral hydrogen power spectrum at z~8.6
• Foregrounds for observations of the cosmological 21 cm line: I. First Westerbork measurements of Galactic emission at 150 MHz in a low latitude field
• Foreground Removal using FastICA: A Showcase of LOFAR-EoR
• Design and characterization of the Large-Aperture Experiment to Detect the Dark Age (LEDA) radiometer systems
• Constraining Baryon--Dark Matter Scattering with the Cosmic Dawn 21-cm Signal
• First Season MWA EoR Power Spectrum Results at Redshift 7
• Constraints on reionisation from the z=7.5 QSO ULASJ1342+0928
• Probing the Dark Ages at Z~20: The SCI-HI 21 cm All-Sky Spectrum Experiment
• Initial deep LOFAR observations of Epoch of Reionization windows: I. The North Celestial Pole
• Are we witnessing the epoch of reionisation at $z=7.1$ from the spectrum of J1120+0641?
• All-sky astrophysical component separation with Fast Independent Component Analysis (FastICA)
• Improving the Epoch of Reionization Power Spectrum Results from Murchison Widefield Array Season 1 Observations
• A simplified, lossless re-analysis of PAPER-64
• BIGHORNS - Broadband Instrument for Global HydrOgen ReioNisation Signal
• The Scale of the Problem : Recovering Images of Reionization with GMCA
• Foregrounds for 21cm Observations of Neutral Gas at High Redshift
• Radio Interferometric Calibration Using The SAGE Algorithm
• Statistical 21-cm Signal Separation via Gaussian Process Regression Analysis
• The redshifted 21-cm signal in the EDGES low-band spectrum
• The Epoch of Reionization
• The 21 centimeter emission from the reionization epoch: extended and point source foregrounds
• Systematic biases in low frequency radio interferometric data due to calibration: the LOFAR EoR case
• Light cone effect on the reionization 21-cm power spectrum
• The first power spectrum limit on the 21-cm signal of neutral hydrogen during the Cosmic Dawn at z=20-25 from LOFAR
• Constraining the intergalactic medium at $z\approx$ 9.1 using LOFAR Epoch of Reionization observations
• Non-parametric foreground subtraction for 21cm epoch of reionization experiments
• SARAS 2 constraints on global 21-cm signals from the Epoch of Reionization
• First Season MWA Phase II EoR Power Spectrum Results at Redshift 7
• The Fundamental Multi-Baseline Mode-Mixing Foreground in 21 cm EoR Observations
• Tight Constraints on the Excess Radio Background at $z=9.1$ from LOFAR
• Interpreting LOFAR 21-cm signal upper limits at z~9.1 in the context of high-z galaxy and reionisation observations
• Characterizing Signal Loss in the 21 cm Reionization Power Spectrum: A Revised Study of PAPER-64
• 21cm foregrounds and polarization leakage: a user's guide on cleaning and mitigation strategies
• Erasing the Milky Way: new cleaning technique applied to GBT intensity mapping data
• Light cone effect on the reionization 21-cm signal II: Evolution, anisotropies and observational implications
• The accuracy of semi-numerical reionization models in comparison with radiative transfer simulations
• Recovery of 21 cm intensity maps with sparse component separation
• The impact of interference excision on 21-cm Epoch of Reionization power spectrum analyses
• 21-cm signal from cosmic dawn - II: Imprints of the light-cone effects
• Identifying Reionization Sources from 21cm Maps using Convolutional Neural Networks
• Sparse component separation for accurate CMB map estimation
• On the contamination of the global 21~cm signal from polarized foregrounds
• Separating the EoR Signal with a Convolutional Denoising Autoencoder: A Deep-learning-based Method
• Observational constraints on key-parameters of cosmic reionisation history
• The 21-cm Line as a Probe of Reionization
• Machine Learning Applied to the Reionization History of the Universe in the 21 cm Signal
• Constraining the reionization history using deep learning from 21cm tomography with the Square Kilometre Array
• Astrophysical components separation of COBE-DMR 4yr data with FastICA
• A LOFAR RFI detection pipeline and its first results
• WMAP 9-year CMB estimation using sparsity

Cited by in corpus (47)

• HI constraints from the cross-correlation of eBOSS galaxies and Green Bank Telescope intensity maps
• SKAO HI Intensity Mapping: Blind Foreground Subtraction Challenge
• Constraining the state of the intergalactic medium during the Epoch of Reionization using MWA 21-cm signal observations
• First upper limits on the 21 cm signal power spectrum from cosmic dawn from one night of observations with NenuFAR
• Gaussian Process Foreground Subtraction and Power Spectrum Estimation for 21 cm Cosmology
• Recovering the Wedge Modes Lost to 21-cm Foregrounds
• Machine learning astrophysics from 21 cm lightcones: impact of network architectures and signal contamination
• A path to precision cosmology: synergy between four promising late-universe cosmological probes
• Gaussian Process Regression for foreground removal in HI intensity mapping experiments
• Redshifted 21-cm bispectrum II: Impact of the spin temperature fluctuations and redshift space distortions on the signal from the Cosmic Dawn
• Patterns of primary beam non-redundancy in close-packed 21 cm array observations
• Eliminating Primary Beam Effect in Foreground Subtraction of Neutral Hydrogen Intensity Mapping Survey with Deep Learning
• Deeper multi-redshift upper limits on the Epoch of Reionization 21-cm signal power spectrum from LOFAR between z=8.3 and z=10.1
• Prospects for measuring dark energy with 21 cm intensity mapping experiments: A joint survey strategy
• Inferring the properties of the sources of reionization using the morphological spectra of the ionized regions
• Power spectrum multipole expansion for HI intensity mapping experiments: unbiased parameter estimation
• Observing the Reionization : Effect of Calibration and Position Errors on Realistic Observation Conditions
• Statistical recovery of the BAO scale from multipoles of the beam-convolved 21cm correlation function
• Impact of instrument and data characteristics in the interferometric reconstruction of the 21 cm power spectrum
• Detecting the HI Power Spectrum in the Post-Reionization Universe with SKA-Low
• Extracting the Signal of Cosmic String Wakes from 21-cm Observations
• Constraints on the state of the IGM at $z\sim 8-10$ using redshifted 21-cm observations with LOFAR
• Redshifted 21-cm bispectrum: Impact of the source models on the signal and the IGM physics from the Cosmic Dawn
• SKA-Low Intensity Mapping Pathfinder Updates: Deeper 21 cm Power Spectrum Limits from Improved Analysis Frameworks
• Probing the intergalactic medium during the Epoch of Reionization using 21-cm signal power spectra
• Astrophysical information from the Rayleigh-Jeans Tail of the CMB
• Spectral modelling of Cygnus A between 110 and 250 MHz. Impact on the LOFAR 21-cm signal power spectrum
• Square Kilometre Array Science Data Challenge 3a: foreground removal for an EoR experiment
• Calibration requirements for Epoch of Reionization 21-cm signal observations -- II. Analytical estimation of the bias and variance with time-correlated residual gains
• Using the sample variance of 21cm maps as a tracer of the ionisation topology
• Detecting galaxy-21-cm cross-correlation during reionization
• Unveiling the Universe with Emerging Cosmological Probes
• First upper limits on the 21-cm signal power spectrum of neutral hydrogen at $z=9.16$ from the LOFAR 3C196 field
• A Differentiable, End-to-End Forward Model for 21 cm Cosmology: Estimating the Foreground, Instrument, and Signal Joint Posterior
• Towards Optimal Foreground Mitigation Strategies for Interferometric HI Intensity Mapping in the Low-Redshift Universe
• Studying the Multi-frequency Angular Power Spectrum of the Cosmic Dawn 21-cm Signal
• Probing the Epoch of Reionization using synergies of line intensity mapping
• Deep learning approach for identification of HII regions during reionization in 21-cm observations -- III. image recovery
• Ionospheric effect on the synthetic Epoch of Reionization observations with the SKA1-Low
• Synthetic Observations with the Square Kilometre Array (SKA) -- development towards an end-to-end pipeline
• Impact of Calibration and Position Errors on Astrophysical Parameters of the HI 21cm Signal
• Reionization Parameter Inference from 3D Minkowski Functionals of the 21 cm Signals
• A simulation experiment of a pipeline based on machine learning for neutral hydrogen intensity mapping surveys
• Foreground removal in HI 21 cm intensity mapping under frequency-dependent beam distortions
• Mitigating gain calibration errors from EoR observations with SKA1-Low AA*
• The Correlation Calibration of PAPER-64 data
• Simulation based inference of the ionization history from the 2D 21 cm power spectrum