Statistical 21-cm Signal Separation via Gaussian Process Regression Analysis
arXiv:1711.10834 · doi:10.1093/mnras/sty1207
Abstract
Detecting and characterizing the Epoch of Reionization and Cosmic Dawn via the redshifted 21-cm hyperfine line of neutral hydrogen will revolutionize the study of the formation of the first stars, galaxies, black holes and intergalactic gas in the infant Universe. The wealth of information encoded in this signal is, however, buried under foregrounds that are many orders of magnitude brighter. These must be removed accurately and precisely in order to reveal the feeble 21-cm signal. This requires not only the modeling of the Galactic and extra-galactic emission, but also of the often stochastic residuals due to imperfect calibration of the data caused by ionospheric and instrumental distortions. To stochastically model these effects, we introduce a new method based on `Gaussian Process Regression' (GPR) which is able to statistically separate the 21-cm signal from most of the foregrounds and other contaminants. Using simulated LOFAR-EoR data that include strong instrumental mode-mixing, we show that this method is capable of recovering the 21-cm signal power spectrum across the entire range . The GPR method is most optimal, having minimal and controllable impact on the 21-cm signal, when the foregrounds are correlated on frequency scales \,MHz and the rms of the signal has . This signal separation improves the 21-cm power-spectrum sensitivity by a factor compared to foreground avoidance strategies and enables the sensitivity of current and future 21-cm instruments such as the {\sl Square Kilometre Array} to be fully exploited.
arXiv comment15 pages, accepted to MNRAS, augmented with new subsection and appendix, no changes to conclusion
References in corpus (45)
- LOFAR: The LOw-Frequency ARray
- Cosmology at Low Frequencies: The 21 cm Transition and the High-Redshift Universe
- 21cmFAST: A Fast, Semi-Numerical Simulation of the High-Redshift 21-cm Signal
- Reionization and Cosmology with 21 cm Fluctuations
- Efficient Simulations of Early Structure Formation and Reionization
- A Nested Sampling Algorithm for Cosmological Model Selection
- Bright Source Subtraction Requirements For Redshifted 21 cm Measurements
- What Next-Generation 21 cm Power Spectrum Measurements Can Teach Us About the Epoch of Reionization
- Four Fundamental Foreground Power Spectrum Shapes for 21 cm Cosmology Observations
- Upper limits on the 21-cm Epoch of Reionization power spectrum from one night with LOFAR
- The Epoch of Reionization Window: I. Mathematical Formalism
- Foreground simulations for the LOFAR - Epoch of Reionization Experiment
- PAPER-64 Constraints on Reionization: The 21cm Power Spectrum at z=8.4
- 21CMMC: an MCMC analysis tool enabling astrophysical parameter studies of the cosmic 21 cm signal
- The Epoch of Reionization Window: II. Statistical Methods for Foreground Wedge Reduction
- A Sensitivity and Array-Configuration Study for Measuring the Power Spectrum of 21cm Emission from Reionization
- The impact of point source subtraction residuals on 21 cm Epoch of Reionization estimation
- K2SC: Flexible systematics correction and detrending of K2 light curves using Gaussian Process regression
- Calibration Requirements for Detecting the 21 cm Epoch of Reionization Power Spectrum and Implications for the SKA
- Foreground Removal using FastICA: A Showcase of LOFAR-EoR
- Foregrounds in Wide-Field Redshifted 21 cm Power Spectra
- Initial deep LOFAR observations of Epoch of Reionization windows: I. The North Celestial Pole
- Realistic Simulations of the Galactic Polarized Foreground: Consequences for 21-cm Reionization Detection Experiments
- The Scale of the Problem : Recovering Images of Reionization with GMCA
- Improving Foreground Subtraction in Statistical Observations of 21 cm Emission from the Epoch of Reionization
- CHIPS: The Cosmological HI Power Spectrum Estimator
- Empirical Covariance Modeling for 21 cm Power Spectrum Estimation: A Method Demonstration and New Limits from Early Murchison Widefield Array 128-Tile Data
- The Impact of Modeling Errors on Interferometer Calibration for 21 cm Power Spectra
- Systematic biases in low frequency radio interferometric data due to calibration: the LOFAR EoR case
- Non-parametric foreground subtraction for 21cm epoch of reionization experiments
- Effects of Antenna Beam Chromaticity on Redshifted 21~cm Power Spectrum and Implications for Hydrogen Epoch of Reionization Array
- SZ and CMB reconstruction using Generalized Morphological Component Analysis
- Improved foreground removal in GMRT 610 MHz observations towards redshifted 21-cm tomography
- The Impact of Foregrounds on Redshift Space Distortion Measurements With the Highly-Redshifted 21 cm Line
- Scintillation noise power spectrum and its impact on high redshift 21-cm observations
- Foreground removal for Square Kilometre Array observations of the Epoch of Reionization with the Correlated Component Analysis
- Robust Strong Lensing Time Delay Estimation
- The wedge bias in reionization 21-cm power spectrum measurements
- Wide-field LOFAR-LBA power-spectra analyses: Impact of calibration, polarization leakage and ionosphere
- Analysing the impact of far-out side-lobes on the imaging performance of the SKA-LOW telescope
- What can the 2008/10 broadband flare of PKS 1502+106 tell us? Nuclear opacity, magnetic fields, and the location of gamma rays
- Ionospheric Power-Spectrum Tomography in Radio Interferometry
- Deconvolving the Wedge: Maximum-Likelihood Power Spectra via Spherical-Wave Visibility Modeling
- A Bayesian analysis of redshifted 21-cm HI signal and foregrounds: Simulations for LOFAR
- Model Selection for Gaussian Process Regression by Approximation Set Coding
Cited by in corpus (86)
- Improved upper limits on the 21-cm signal power spectrum of neutral hydrogen at from LOFAR
- Data Analysis for Precision 21 cm Cosmology
- Deep multi-redshift limits on Epoch of Reionisation 21cm Power Spectra from Four Seasons of Murchison Widefield Array Observations
- The first power spectrum limit on the 21-cm signal of neutral hydrogen during the Cosmic Dawn at z=20-25 from LOFAR
- Constraining the intergalactic medium at 9.1 using LOFAR Epoch of Reionization observations
- SKAO HI Intensity Mapping: Blind Foreground Subtraction Challenge
- 21cm foregrounds and polarization leakage: a user's guide on cleaning and mitigation strategies
- Recovery of 21 cm intensity maps with sparse component separation
- Constraining the state of the intergalactic medium during the Epoch of Reionization using MWA 21-cm signal observations
- The impact of interference excision on 21-cm Epoch of Reionization power spectrum analyses
- Comparing Foreground Removal Techniques for Recovery of the LOFAR-EoR 21cm Power Spectrum
- Gaussian Process Foreground Subtraction and Power Spectrum Estimation for 21 cm Cosmology
- HI 21cm Cosmology and the Bi-spectrum: Closure Diagnostics in Massively Redundant Interferometric Arrays
- The AARTFAAC Cosmic Explorer: observations of the 21-cm power spectrum in the EDGES absorption trough
- Separating the EoR Signal with a Convolutional Denoising Autoencoder: A Deep-learning-based Method
- A path to precision cosmology: synergy between four promising late-universe cosmological probes
- Quantifying Suppression of the Cosmological 21-cm Signal due to Direction Dependent Gain Calibration in Radio Interferometers
- Gaussian Process Regression for foreground removal in HI intensity mapping experiments
- Eliminating Primary Beam Effect in Foreground Subtraction of Neutral Hydrogen Intensity Mapping Survey with Deep Learning
- Joint estimation of the Epoch of Reionization power spectrum and foregrounds
- Demonstrating the Tapered Gridded Estimator (TGE) for the Cosmological HI 21-cm Power Spectrum using GMRT observations
- Foreground modelling via Gaussian process regression: an application to HERA data
- Predictions for measuring the 21-cm multi-frequency angular power spectrum using SKA-Low
- Validation of the HERA Phase I Epoch of Reionization 21 cm Power Spectrum Software Pipeline
- Inferring the properties of the sources of reionization using the morphological spectra of the ionized regions
- The effect of baseline layouts on the EoR foreground wedge: a semi-analytical approach
- The Very Knotty Lenser: exploring the role of regularization in source and potential reconstructions using Gaussian Process Regression
- Deep learning approach for identification of HII regions during reionization in 21-cm observations -- II. foreground contamination
- The bispectrum and 21cm foregrounds during the Epoch of Reionization
- Extracting the 21-cm Power Spectrum and the reionization parameters from mock datasets using Artificial Neural Networks
- Cleaning foregrounds from single-dish 21cm intensity maps with Kernel Principal Component Analysis
- Observing the Reionization : Effect of Calibration and Position Errors on Realistic Observation Conditions
- A Semi-blind PCA-based Foreground Subtraction Method for 21 cm Intensity Mapping
- Detecting the HI Power Spectrum in the Post-Reionization Universe with SKA-Low
- Determination of cosmic curvature independent of the sound horizon and using BOSS/eBOSS and DESI DR1 BAO observations
- Impact of instrument and data characteristics in the interferometric reconstruction of the 21 cm power spectrum
- Extracting the Signal of Cosmic String Wakes from 21-cm Observations
- Exploring the consequences of chromatic data excision in 21-cm Epoch of Reionization power spectrum observations
- On the general nature of 21cm-Lyman- emitters cross-correlations during reionisation
- Strong-lensing source reconstruction with variationally optimised Gaussian processes
- All Sky Modelling Requirements for Bayesian 21 cm Power Spectrum Estimation with BayesEoR
- SKA-Low Intensity Mapping Pathfinder Updates: Deeper 21 cm Power Spectrum Limits from Improved Analysis Frameworks
- Characterization Of Inpaint Residuals In Interferometric Measurements of the Epoch Of Reionization
- Improved upper limits on the 21-cm signal power spectrum at and from an optimal field observed with NenuFAR
- Towards -cm intensity mapping at with uGMRT using the tapered gridded estimator III: Foreground removal
- Non-parametric Reconstruction of Photon Escape Fraction from Reionization
- Predicting 21cm-line map from Lyman emitter distribution with Generative Adversarial Networks
- Towards -cm intensity mapping at with uGMRT using the tapered gridded estimator -- IV. Wideband analysis
- Square Kilometre Array Science Data Challenge 3a: foreground removal for an EoR experiment
- Ionospheric contributions to the excess power in high-redshift 21-cm power-spectrum observations with LOFAR
- Analysing the Epoch of Reionization with three-point correlation functions and machine learning techniques
- Towards -cm intensity mapping at with uGMRT using the tapered gridded estimator II: Cross-polarization power spectrum
- Cross-Correlation Forecast of CSST Spectroscopic Galaxy and MeerKAT Neutral Hydrogen Intensity Mapping Surveys
- Why and When to Expect Gaussian Error Distributions in Epoch of Reionization 21-cm Power Spectrum Measurements
- First upper limits on the 21-cm signal power spectrum of neutral hydrogen at from the LOFAR 3C196 field
- Statistical Performance of Radio Interferometric Calibration
- Unveiling the Universe with Emerging Cosmological Probes
- Towards Optimal Foreground Mitigation Strategies for Interferometric HI Intensity Mapping in the Low-Redshift Universe
- Studying the Multi-frequency Angular Power Spectrum of the Cosmic Dawn 21-cm Signal
- A Differentiable, End-to-End Forward Model for 21 cm Cosmology: Estimating the Foreground, Instrument, and Signal Joint Posterior
- Gaussian Process Modelling for Improved Resolution in Faraday Depth Reconstruction
- The Tracking Tapered Gridded Estimator (TTGE) for the power spectrum from drift scan observations
- A Comparative Analysis To Deal With Missing Spectral Information Caused By RFI In Cosmological HI 21CM Observations
- Constraining cosmic reionization by combining the kinetic Sunyaev-Zel'dovich and the 21 cm power spectra
- Deep learning approach for identification of HII regions during reionization in 21-cm observations -- III. image recovery
- Bayesian evidence for flux scale errors in Galactic synchrotron maps
- 21 cm Intensity Mapping with the DSA-2000
- Ionospheric effect on the synthetic Epoch of Reionization observations with the SKA1-Low
- Field-level Reconstruction from Foreground-Contaminated 21-cm Maps
- A novel radio imaging method for physical spectral index modelling
- Simulations of primary beam effects on the cosmic bispectrum phase observed with the Hydrogen Epoch of Reionization Array
- Impact of Calibration and Position Errors on Astrophysical Parameters of the HI 21cm Signal
- Exploring One-point Statistics in HERA Phase I Data: Effects of Foregrounds and Systematics on Measuring One-Point Statistics
- Foreground removal and angular power spectrum estimation of 21 cm signal using harmonic space ILC method
- Extracting the Epoch of Reionization Signal with 3D U-Net Neural Networks Using Data-driven Systematic Effect Model
- Model independent calibration for sound horizon combining observations of supernovae and transversal BAO measurements
- Robust Foregrounds Removal for 21-cm Experiments
- A Bayesian approach to high fidelity interferometric calibration I: mathematical formalism
- Photometry on Structured Backgrounds: Local Pixelwise Infilling by Regression
- Mitigating gain calibration errors from EoR observations with SKA1-Low AA*
- Simulation based inference of the ionization history from the 2D 21 cm power spectrum
- Seeing Wiggles without Seeing Wiggles: BAO Recovery in 21 cm Intensity Mapping with Deep Learning
- Bayes-SCF: A Bayesian filter to mitigate foreground leakage in the 21-cm power spectrum
- Impact of 21-cm foreground mitigation strategies on reionization power spectrum constraints
- Foreground Subtraction with a Tensor-Based Oriented Singular Value Decomposition Method for HI Experiments
- Simulating a full-sky high resolution Galactic synchrotron spectral index map using neural networks