21cm foregrounds and polarization leakage: a user's guide on cleaning and mitigation strategies
arXiv:2010.02907 · doi:10.1093/mnras/stab856
Abstract
The success of HI intensity mapping is largely dependent on how well 21cm foreground contamination can be controlled. In order to progress our understanding further, we present a range of simulated foreground data from four different \,deg sky regions, with and without effects from polarization leakage. Combining these with underlying cosmological HI simulations creates a range of single-dish intensity mapping test cases that require different foreground treatments. This allows us to conduct the most generalized study to date into 21cm foregrounds and their cleaning techniques for the post-reionization era. We first provide a pedagogical review of the most commonly used blind foreground removal techniques (PCA/SVD, FASTICA, GMCA). We also trial a non-blind parametric fitting technique and discuss potential hybridization of methods. We highlight the similarities and differences in these techniques finding that the blind methods produce near equivalent results, and we explain the fundamental reasons for this. The simulations allow an exact decomposition of the resulting cleaned data and we analyse the contribution from foreground residuals. Our results demonstrate that polarized foreground residuals should be generally subdominant to HI on small scales (). However, on larger scales, results are more region dependent. In some cases, aggressive cleans severely damp HI power but still leave dominant foreground residuals. We also demonstrate the gain from cross-correlations with optical galaxy surveys, where extreme levels of residual foregrounds can be circumvented. However, these residuals still contribute to errors and we discuss the optimal balance between over- and under-cleaning.
arXiv comment21 pages, 16 figures. Changes made in response to reviewer report. Noted changes from V1: analysis now only performed on two foreground regions (excluding Galactic Plane and Barnard's loop since these were very high emission regions). General results and conclusions unchanged though. Version 2 accepted for publication in MNRAS
References in corpus (71)
- Scikit-learn: Machine Learning in Python
- Array Programming with NumPy
- emcee: The MCMC Hammer
- The NumPy array: a structure for efficient numerical computation
- Planck 2015 results. XIII. Cosmological parameters
- MultiDark simulations: the story of dark matter halo concentrations and density profiles
- Planck 2018 results. IV. Diffuse component separation
- Baryon Acoustic Oscillation Intensity Mapping as a Test of Dark Energy
- Measurement of 21 cm brightness fluctuations at z ~ 0.8 in cross-correlation
- Improved upper limits on the 21-cm signal power spectrum of neutral hydrogen at from LOFAR
- Cosmology with Phase 1 of the Square Kilometre Array; Red Book 2018: Technical specifications and performance forecasts
- Joint Bayesian component separation and CMB power spectrum estimation
- Multifrequency analysis of 21 cm fluctuations from the Era of Reionization
- Upper limits on the 21-cm Epoch of Reionization power spectrum from one night with LOFAR
- Foreground simulations for the LOFAR - Epoch of Reionization Experiment
- Semi-Analytic Galaxy Evolution (SAGE): Model Calibration and Basic Results
- Determination of z~0.8 neutral hydrogen fluctuations using the 21 cm intensity mapping auto-correlation
- Component separation methods for the Planck mission
- An improved map of the Galactic Faraday sky
- HI intensity mapping : a single dish approach
- Data Analysis for Precision 21 cm Cosmology
- Towards a free-free template for CMB foregrounds
- Separation of anomalous and synchrotron emissions using WMAP polarization data
- Multi-Detector Multi-Component spectral matching and applications for CMB data analysis
- Ingredients for 21cm intensity mapping
- A Method for 21cm Power Spectrum Estimation in the Presence of Foregrounds
- Foreground Removal using FastICA: A Showcase of LOFAR-EoR
- Coaxing Cosmic 21cm Fluctuations from the Polarized Sky using m-mode Analysis
- Lack of clustering in low-redshift 21-cm intensity maps cross-correlated with 2dF galaxy densities
- The WiggleZ Dark Energy Survey: Direct constraints on blue galaxy intrinsic alignments at intermediate redshifts
- Blind foreground subtraction for intensity mapping experiments
- Neutral hydrogen surveys for high redshift galaxy clusters and proto-clusters
- Realistic Simulations of the Galactic Polarized Foreground: Consequences for 21-cm Reionization Detection Experiments
- Statistical 21-cm Signal Separation via Gaussian Process Regression Analysis
- Using HI to probe large scale structures at z ~ 3
- Metal Enrichment of the ICM: a 3-D Picture of Chemical and Dynamical Properties
- The effect of foreground subtraction on cosmological measurements from Intensity Mapping
- Beyond the plane-parallel approximation for redshift surveys
- Interpreting the unresolved intensity of cosmologically redshifted line radiation
- HI intensity mapping with MeerKAT: Calibration pipeline for multi-dish autocorrelation observations
- The Effects of Polarized Foregrounds on 21cm Epoch of Reionization Power Spectrum Measurements
- MultiDark-Galaxies: data release and first results
- Fast simulations for intensity mapping experiments
- Simulations for single-dish intensity mapping experiments
- Erasing the Milky Way: new cleaning technique applied to GBT intensity mapping data
- Baryonic acoustic oscillations from 21cm intensity mapping: the Square Kilometre Array case
- Extracting HI cosmological signal with Generalized Needlet Internal Linear Combination
- Joint Planck and WMAP CMB Map Reconstruction
- HI and cosmological constraints from intensity mapping, optical, and CMB surveys
- MeerKLASS: MeerKAT Large Area Synoptic Survey
- Recovery of 21 cm intensity maps with sparse component separation
- The atomic Hydrogen content of the post-reionization Universe
- Hi intensity mapping with MeerKAT: Primary beam effects on foreground cleaning
- Impact of Foregrounds on HI Intensity Mapping Cross-Correlations with Optical Surveys
- 21 cm observation of LSS at z~1 Instrument sensitivity and foreground subtraction
- Impact of Simulated 1/f Noise for HI Intensity Mapping Experiments
- Sparse component separation for accurate CMB map estimation
- Cosmological parameter forecasts for HI intensity mapping experiments using the angular power spectrum
- HI intensity mapping with MeerKAT: 1/f noise analysis
- Power spectrum multipoles on the curved sky: an application to the 6-degree Field Galaxy Survey
- The cross-correlation between 21cm intensity mapping maps and the Lyman-alpha forest in the post-reionization era
- The degeneracy between primordial non-Gaussianity and foregrounds in 21cm intensity mapping experiments
- Potential Impact of Global Navigation Satellite Services on Total Power HI Intensity Mapping Surveys
- A novel method for component separation of extended sources in X-ray astronomy
- BeyondPlanck I. Global Bayesian analysis of the Planck Low Frequency Instrument data
- Multipole expansion for HI intensity mapping experiments: simulations and modelling
- Power spectrum multipole expansion for HI intensity mapping experiments: unbiased parameter estimation
- 21cm Signal Recovery via the Robust Principle Component Analysis
- Accurate Polarization Calibration at 800 MHz with the Green Bank Telescope
- An HI intensity mapping survey with a Phased Array Feed
- HIR4: cosmology from a simulated neutral hydrogen full sky using Horizon Run 4
Cited by in corpus (46)
- HI intensity mapping with MeerKAT: power spectrum detection in cross-correlation with WiggleZ galaxies
- HI constraints from the cross-correlation of eBOSS galaxies and Green Bank Telescope intensity maps
- SKAO HI Intensity Mapping: Blind Foreground Subtraction Challenge
- Comparing Foreground Removal Techniques for Recovery of the LOFAR-EoR 21cm Power Spectrum
- Hi intensity mapping with MeerKAT: Primary beam effects on foreground cleaning
- Recovering the Wedge Modes Lost to 21-cm Foregrounds
- Gaussian Process Regression for foreground removal in HI intensity mapping experiments
- Cosmology Intertwined: A Review of the Particle Physics, Astrophysics, and Cosmology Associated with the Cosmological Tensions and Anomalies
- The foreground transfer function for HI intensity mapping signal reconstruction: MeerKLASS and precision cosmology applications
- Gravitational waves HI intensity mapping: cosmological and astrophysical applications
- A Map of Diffuse Radio Emission at 182 MHz to Enhance Epoch of Reionization Observations in the Southern Hemisphere
- Detecting the power spectrum turnover with HI intensity mapping
- Prospects for measuring dark energy with 21 cm intensity mapping experiments
- The HI intensity mapping bispectrum including observational effects
- Cleaning foregrounds from single-dish 21cm intensity maps with Kernel Principal Component Analysis
- Eliminating polarization leakage effect for neutral hydrogen intensity mapping with deep learning
- Testing gravity with gravitational waves electromagnetic probes cross-correlations
- Detecting the HI Power Spectrum in the Post-Reionization Universe with SKA-Low
- Multipole expansion for 21cm Intensity Mapping power spectrum: forecasted cosmological parameters estimation for the SKA Observatory
- Measuring ultra-large scale effects in the presence of 21cm intensity mapping foregrounds
- HI intensity mapping correlation function from UNIT simulations: BAO and observationally induced anisotropy
- 1/f Noise Analysis for FAST HI Intensity Mapping Drift-Scan Experiment
- Interferometric HI intensity mapping: perturbation theory predictions and foreground removal effects
- Emission-line Stacking of 21cm Intensity Maps with MeerKLASS: Inference Pipeline and Application to the L-band Deep-field Data
- 21-cm foreground removal using AI and frequency-difference technique
- Radio-optical synergies at high redshift to constrain primordial non-Gaussianity
- Cosmological constraints from low redshift 21 cm intensity mapping with machine learning
- The BINGO project VIII: On the recoverability of the BAO signal on HI intensity mapping simulations
- Unveiling the Universe with Emerging Cosmological Probes
- First upper limits on the 21-cm signal power spectrum of neutral hydrogen at from the LOFAR 3C196 field
- Baryon acoustic oscillations from HI intensity mapping: the importance of cross-correlations in the monopole and quadrupole
- Towards Optimal Foreground Mitigation Strategies for Interferometric HI Intensity Mapping in the Low-Redshift Universe
- Bayesian evidence for flux scale errors in Galactic synchrotron maps
- Prospects for cosmological research with the FAST array: 21-cm intensity mapping survey observation strategies
- HI Intensity Mapping with the MIGHTEE Survey: First Results of the HI Power Spectrum
- FAST Drift Scan Survey for HI Intensity Mapping. II. Stacking-based Beam Construction of the 19-feed Array at GHz
- Spin-based removal of instrumental systematics in 21cm intensity mapping surveys
- Extracting the Epoch of Reionization Signal with 3D U-Net Neural Networks Using Data-driven Systematic Effect Model
- An Alcock-Paczynski Test on Reionization Bubbles for Cosmology
- A simulation experiment of a pipeline based on machine learning for neutral hydrogen intensity mapping surveys
- Needlets and foreground removal for SKAO hydrogen intensity maps
- Foreground removal in HI 21 cm intensity mapping under frequency-dependent beam distortions
- Exploring delaying and heating effects on the 21-cm signature of fuzzy dark matter
- Deep learning with hybrid frequency differencing and principal component analysis for 21-cm foreground and beam mitigation
- Interpreting the HI 21-cm cosmology maps through Largest Cluster Statistics. Part II. Impact of the realistic foreground and instrumental noise on synthetic SKA1-Low observations
- Simulating a full-sky high resolution Galactic synchrotron spectral index map using neural networks