Square Kilometre Array Science Data Challenge 3a: foreground removal for an EoR experiment

Abstract

We present and analyse the results of the Science data challenge 3a (SDC3a, https://sdc3.skao.int/challenges/foregrounds), an EoR foreground-removal community-wide exercise organised by the Square Kilometre Array Observatory (SKAO). The challenge ran for 8 months, from March to October 2023. Participants were provided with realistic simulations of SKA-Low data between 106 MHz and 196 MHz, including foreground contamination from extragalactic as well as Galactic emission, instrumental and systematic effects. They were asked to deliver cylindrical power spectra of the EoR signal, cleaned from all corruptions, and the corresponding confidence levels. Here we describe the approaches taken by the 17 teams that completed the challenge, and we assess their performance using different metrics. The challenge results provide a positive outlook on the capabilities of current foreground-mitigation approaches to recover the faint EoR signal from SKA-Low observations. The median error committed in the EoR power spectrum recovery is below the true signal for seven teams, although in some cases there are some significant outliers. The smallest residual overall is $4.2_{-4.2}^{+20}\times 10^{-4}{\mathrm{K}}^2{\mathrm{h}}^{-3}$cMpc${}^3$ across all considered scales and frequencies. The estimation of confidence levels provided by the teams is overall less accurate, with the true error being typically under-estimated, sometimes very significantly. The most accurate error bars account for $60\pm 20$\% of the true errors committed. The challenge results provide a means for all teams to understand and improve their performance. This challenge indicates that the comparison between independent pipelines could be a powerful tool to assess residual biases and improve error estimation.

29 pages, 10 figures, submitted to MNRAS

References in corpus (74)

• Scikit-learn: Machine Learning in Python
• SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
• The Murchison Widefield Array: the Square Kilometre Array Precursor at low radio frequencies
• An absorption profile centred at 78 megahertz in the sky-averaged spectrum
• WSClean: an implementation of a fast, generic wide-field imager for radio astronomy
• 21cmFAST: A Fast, Semi-Numerical Simulation of the High-Redshift 21-cm Signal
• Hydrogen Epoch of Reionization Array (HERA)
• GaLactic and Extragalactic All-sky Murchison Widefield Array (GLEAM) survey I: A low-frequency extragalactic catalogue
• PolyChord: nested sampling for cosmology
• PolyChord: next-generation nested sampling
• An optimized algorithm for multi-scale wideband deconvolution of radio astronomical images
• Four Fundamental Foreground Power Spectrum Shapes for 21 cm Cosmology Observations
• Improved upper limits on the 21-cm signal power spectrum of neutral hydrogen at $\mathbf{z}\approx 9.1$ from LOFAR
• Upper limits on the 21-cm Epoch of Reionization power spectrum from one night with LOFAR
• The Epoch of Reionization Window: I. Mathematical Formalism
• New Limits on 21cm EoR From PAPER-32 Consistent with an X-Ray Heated IGM at z=7.7
• Foreground simulations for the LOFAR - Epoch of Reionization Experiment
• Inferring the astrophysics of reionization and cosmic dawn from galaxy luminosity functions and the 21-cm signal
• The pre-launch Planck Sky Model: a model of sky emission at submillimetre to centimetre wavelengths
• The Phase II Murchison Widefield Array: Design Overview
• Deep multi-redshift limits on Epoch of Reionisation 21cm Power Spectra from Four Seasons of Murchison Widefield Array Observations
• First Results from HERA Phase I: Upper Limits on the Epoch of Reionization 21 cm Power Spectrum
• An Improved Model of Diffuse Galactic Radio Emission from 10 MHz to 5 THz
• Calibration Requirements for Detecting the 21 cm Epoch of Reionization Power Spectrum and Implications for the SKA
• The GMRT-EoR Experiment: A new upper limit on the neutral hydrogen power spectrum at z~8.6
• Real-Time Calibration of the Murchison Widefield Array
• Foreground Removal using FastICA: A Showcase of LOFAR-EoR
• Source finding in the era of the SKA (precursors): Aegean 2.0
• The Cosmic Dawn and Epoch of Reionization with the Square Kilometre Array
• 21cmFAST v3: A Python-integrated C code forgenerating 3D realizations of the cosmic 21cm signal
• A simplified, lossless re-analysis of PAPER-64
• Improving the Epoch of Reionization Power Spectrum Results from Murchison Widefield Array Season 1 Observations
• The Tiered Radio Extragalactic Continuum Simulation (T-RECS)
• CHIPS: The Cosmological HI Power Spectrum Estimator
• Statistical 21-cm Signal Separation via Gaussian Process Regression Analysis
• First results on the Epoch of Reionization from First Light with SARAS 2
• The 21 cm Power Spectrum from the Cosmic Dawn: First Results from the OVRO-LWA
• Toward Empirical Constraints on the Global Redshifted 21 cm Brightness Temperature During the Epoch of Reionization
• First Limits on the 21 cm Power Spectrum during the Epoch of X-ray heating
• First Season MWA Phase II EoR Power Spectrum Results at Redshift 7
• The Importance of Wide-field Foreground Removal for 21 cm Cosmology: A Demonstration With Early MWA Epoch of Reionization Observations
• Deep Low-Frequency Radio Observations of the NOAO Bootes Field: I. Data Reduction and Catalog Construction
• A new MWA limit on the 21 cm Power Spectrum at Redshifts $\sim$ 13 $-$ 17
• Imaging the redshifted 21-cm pattern around the first sources during the cosmic dawn using the SKA
• GaLactic and Extragalactic All-sky Murchison Widefield Array (GLEAM) survey II: Galactic Plane $345^{\circ }<l<67^{\circ }$, $180^{\circ }<l<240^{\circ }$
• Visibility based angular power spectrum estimation in low frequency radio interferometric observations
• First upper limits on the 21 cm signal power spectrum from cosmic dawn from one night of observations with NenuFAR
• Comparing Foreground Removal Techniques for Recovery of the LOFAR-EoR 21cm Power Spectrum
• SARAS 3 CD/EoR Radiometer: Design and Performance of the Receiver
• Hi intensity mapping with MeerKAT: Primary beam effects on foreground cleaning
• A 21-cm power spectrum at 48 MHz, using the Owens Valley Long Wavelength Array
• Extremely deep 150 MHz source counts from the LoTSS Deep Fields
• The AARTFAAC Cosmic Explorer: observations of the 21-cm power spectrum in the EDGES absorption trough
• Gaussian Process Regression for foreground removal in HI intensity mapping experiments
• Polarization leakage in epoch of reionization windows: II. Primary beam model and direction dependent calibration
• Deep learning approach for identification of HII regions during reionization in 21-cm observations
• Wide-field LOFAR-LBA power-spectra analyses: Impact of calibration, polarization leakage and ionosphere
• The foreground transfer function for HI intensity mapping signal reconstruction: MeerKLASS and precision cosmology applications
• A computationally efficient autoregressive method for generating phase screens with frozen flow and turbulence in optical simulations
• Eliminating Primary Beam Effect in Foreground Subtraction of Neutral Hydrogen Intensity Mapping Survey with Deep Learning
• Status and progress of China SKA Regional Centre prototype
• Simulations of Galactic polarized synchrotron emission for Epoch of Reionization observations
• Exploring the Cosmic Reionization Epoch in Frequency Space: An Improved Approach to Remove the Foreground in 21 cm Tomography
• A direct detection of neutral hydrogen intensity mapping on Mpc scales at $z\approx 0.32$ and $z\approx 0.44$
• Deep learning approach for identification of HII regions during reionization in 21-cm observations -- II. foreground contamination
• Joint Multichannel Deconvolution and Blind Source Separation
• Cleaning foregrounds from single-dish 21cm intensity maps with Kernel Principal Component Analysis
• The Tiered Radio Extragalactic Continuum (T-RECS) simulation II: HI emission and continuum-HI cross-correlation
• Detecting the HI Power Spectrum in the Post-Reionization Universe with SKA-Low
• First look at the multiphase interstellar medium with synthetic observations of low-frequency Faraday tomography
• GaLactic and Extragalactic All-sky Murchison Widefield Array (GLEAM) survey III: South Galactic Pole data release
• Degree-Scale Galactic Radio Emission at 122 MHz around the North Celestial Pole with LOFAR-AARTFAAC
• Understanding spectral artefacts in SKA-LOW 21-cm cosmology experiments: the impact of cable reflections
• QUIJOTE scientific results -- IX. Radio sources in the QUIJOTE-MFI wide survey maps

Cited by in corpus (6)

• Sensitivity toward dark matter annihilation imprints on 21-cm signal with SKA-Low: A convolutional neural network approach
• Probing Interacting Dark Sectors with upcoming Post-Reionization and Galaxy Surveys
• Foreground Subtraction with a Tensor-Based Oriented Singular Value Decomposition Method for HI Experiments
• Impact of 21-cm foreground mitigation strategies on reionization power spectrum constraints
• Transformer-Based Source Detection and Morphological Classification in LOFAR Deep-Field Continuum Images
• Mitigating incoherent excess variance in high-redshift 21 cm observations with multi-output cross-Gaussian process regression