Deep learning with hybrid frequency differencing and principal component analysis for 21-cm foreground and beam mitigation
arXiv:2511.15072 · doi:10.1103/3wc5-47h6
Abstract
Twenty-one-centimeter intensity mapping is a powerful probe of the large-scale distribution of neutral hydrogen (HI) and cosmological observables such as baryon acoustic oscillations. A major challenge is contamination from bright foregrounds and frequency-dependent beam effects, which can lead to signal loss in traditional methods such as principal component analysis (PCA). We develop a hybrid approach that trains a U-shaped convolutional neural network (UNet) on two input channels derived from frequency differencing (FD) and PCA cleaning, enabling it to exploit their complementary behavior across different scales. This two-channel strategy achieves improved performance, maintaining the cross-correlation power spectrum close to unity on large scales under a cosine beam and improving by 5\%-8\% relative to either FD- or PCA-based UNet alone. We further show that the method can robustly recover the HI signal even when the beam model is imperfect and differs between training and testing, with the large-scale cross-correlation remaining close to unity within the level. These results demonstrate that the proposed approach provides a robust framework for HI signal reconstruction under realistic observational conditions.
20 pages, 22 figures
References in corpus (52)
- HEALPix -- a Framework for High Resolution Discretization, and Fast Analysis of Data Distributed on the Sphere
- A model of diffuse Galactic Radio Emission from 10 MHz to 100 GHz
- Baryon Acoustic Oscillation Intensity Mapping as a Test of Dark Energy
- Measurement of 21 cm brightness fluctuations at z ~ 0.8 in cross-correlation
- Multifrequency analysis of 21 cm fluctuations from the Era of Reionization
- The pre-launch Planck Sky Model: a model of sky emission at submillimetre to centimetre wavelengths
- HI intensity mapping : a single dish approach
- Data Analysis for Precision 21 cm Cosmology
- Radio Foregrounds for the 21cm Tomography of the Neutral Intergalactic Medium at High Redshifts
- All-Sky Interferometry with Spherical Harmonic Transit Telescopes
- A Method for 21cm Power Spectrum Estimation in the Presence of Foregrounds
- Foreground Removal using FastICA: A Showcase of LOFAR-EoR
- Lack of clustering in low-redshift 21-cm intensity maps cross-correlated with 2dF galaxy densities
- Neutral hydrogen surveys for high redshift galaxy clusters and proto-clusters
- The Scale of the Problem : Recovering Images of Reionization with GMCA
- Foregrounds for 21cm Observations of Neutral Gas at High Redshift
- A ground-based 21cm Baryon acoustic oscillation survey
- HI intensity mapping with MeerKAT: power spectrum detection in cross-correlation with WiggleZ galaxies
- HI constraints from the cross-correlation of eBOSS galaxies and Green Bank Telescope intensity maps
- Detection of Cosmological 21 cm Emission with the Canadian Hydrogen Intensity Mapping Experiment
- Interpreting the unresolved intensity of cosmologically redshifted line radiation
- HI intensity mapping with MeerKAT: Calibration pipeline for multi-dish autocorrelation observations
- Fast simulations for intensity mapping experiments
- 21cm foregrounds and polarization leakage: a user's guide on cleaning and mitigation strategies
- Extracting HI cosmological signal with Generalized Needlet Internal Linear Combination
- deep21: a Deep Learning Method for 21cm Foreground Removal
- The 21cm Power Spectrum After Reionization
- The BINGO Project I: Baryon Acoustic Oscillations from Integrated Neutral Gas Observations
- Gaussian Process Foreground Subtraction and Power Spectrum Estimation for 21 cm Cosmology
- Hi intensity mapping with MeerKAT: Primary beam effects on foreground cleaning
- The Tianlai Dish Pathfinder Array: design, operation and performance of a prototype transit radio interferometer
- Recovering the Wedge Modes Lost to 21-cm Foregrounds
- Separating the EoR Signal with a Convolutional Denoising Autoencoder: A Deep-learning-based Method
- Bayesian semi-blind component separation for foreground removal in interferometric 21-cm observations
- Eliminating Primary Beam Effect in Foreground Subtraction of Neutral Hydrogen Intensity Mapping Survey with Deep Learning
- Three-dimensional non-vacuum pulsar outer-gap model: Localized acceleration electric field in the higher altitudes
- Joint estimation of the Epoch of Reionization power spectrum and foregrounds
- Prospects for measuring dark energy with 21 cm intensity mapping experiments: A joint survey strategy
- Deep learning approach for identification of HII regions during reionization in 21-cm observations -- II. foreground contamination
- A Bayesian analysis of redshifted 21-cm HI signal and foregrounds: Simulations for LOFAR
- The Tianlai dish array low-z surveys forecasts
- Accurate Polarization Calibration at 800 MHz with the Green Bank Telescope
- Machine-learning recovery of foreground wedge-removed 21-cm light cones for high- galaxy mapping
- A Semi-blind PCA-based Foreground Subtraction Method for 21 cm Intensity Mapping
- HIR4: cosmology from a simulated neutral hydrogen full sky using Horizon Run 4
- All Sky Modelling Requirements for Bayesian 21 cm Power Spectrum Estimation with BayesEoR
- HIR4: Cosmological signatures imprinted on the cross correlation between 21-cm map and galaxy clustering
- 21-cm foreground removal using AI and frequency-difference technique
- Toward a more stringent test of gravity with redshift space power spectrum: simultaneous probe of growth and amplitude of large-scale structure
- Deep learning approach for identification of HII regions during reionization in 21-cm observations -- III. image recovery
- HI Intensity Mapping with the MIGHTEE Survey: First Results of the HI Power Spectrum
- Field-level Reconstruction from Foreground-Contaminated 21-cm Maps