Exploring Machine Learning Regression Models for Advancing Foreground Mitigation and Global 21cm Signal Parameter Extraction

Abstract

Extracting parameters from the global 21cm signal is crucial for understanding the early Universe. However, detecting the 21cm signal is challenging due to the brighter foreground and associated observational difficulties. In this study, we evaluate the performance of various machine-learning regression models to improve parameter extraction and foreground removal. This evaluation is essential for selecting the most suitable machine learning regression model based on computational efficiency and predictive accuracy. We compare four models: Random Forest Regressor (RFR), Gaussian Process Regressor (GPR), Support Vector Regressor (SVR), and Artificial Neural Networks (ANN). The comparison is based on metrics such as the root mean square error (RMSE) and $R^2$ scores. We examine their effectiveness across different dataset sizes and conditions, including scenarios with foreground contamination. Our results indicate that ANN consistently outperforms the other models, achieving the lowest RMSE and the highest $R^2$ scores across multiple cases. While GPR also performs well, it is computationally intensive, requiring significant RAM and longer execution times. SVR struggles with large datasets due to its high computational costs, and RFR demonstrates the weakest accuracy among the models tested. We also found that employing Principal Component Analysis (PCA) as a preprocessing step significantly enhances model performance, especially in the presence of foregrounds.

17 pages, 8 figures, accepted for publication in JOAA

References in corpus (42)

• An absorption profile centred at 78 megahertz in the sky-averaged spectrum
• 21-cm cosmology
• Improved upper limits on the 21-cm signal power spectrum of neutral hydrogen at $\mathbf{z}\approx 9.1$ from LOFAR
• The Global 21 Centimeter Background from High Redshifts
• Fossil HII Regions: Self-Limiting Star Formation at High Redshift
• Radio Foregrounds for the 21cm Tomography of the Neutral Intergalactic Medium at High Redshifts
• An Improved Method for 21cm Foreground Removal
• Likelihood-free inference with neural compression of DES SV weak lensing map statistics
• The Effects of Reionization on Lyman-alpha Galaxy Surveys
• The Epoch of Reionization
• The 21 centimeter emission from the reionization epoch: extended and point source foregrounds
• The first power spectrum limit on the 21-cm signal of neutral hydrogen during the Cosmic Dawn at z=20-25 from LOFAR
• Decoding the X-ray Properties of Pre-Reionization Era Sources
• Foreground Model and Antenna Calibration Errors in the Measurement of the Sky-Averaged λ21 cm Signal at z~20
• Emulation of reionization simulations for Bayesian inference of astrophysics parameters using neural networks
• Chromatic effects in the 21 cm global signal from the cosmic dawn
• A General Bayesian Framework for Foreground Modelling and Chromaticity Correction for Global 21cm Experiments
• Emulating the Global 21-cm Signal from Cosmic Dawn and Reionization
• The CAMELS Multifield Dataset: Learning the Universe's Fundamental Parameters with Artificial Intelligence
• An MCMC approach to extracting the global 21-cm signal during the cosmic dawn from sky-averaged radio observations
• Interpreting the Global 21-cm Signal from High Redshifts. II. Parameter Estimation for Models of Galaxy Formation
• On the detection of spectral ripples from the Recombination Epoch
• maxsmooth: Rapid Maximally Smooth Function Fitting With Applications in Global 21-cm Cosmology
• Evaluating machine learning techniques for predicting power spectra from reionization simulations
• GLOBALEMU: A novel and robust approach for emulating the sky-averaged 21-cm signal from the cosmic dawn and epoch of reionisation
• Quantifying Ionospheric Effects on Global 21-cm Observations
• Global 21-cm signal extraction from foreground and instrumental effects I: Pattern recognition framework for separation using training sets
• Optimized Multi-Frequency Spectra for Applications in Radiative Feedback and Cosmological Reionization
• Global 21-cm Signal Extraction from Foreground and Instrumental Effects II: Efficient and Self-Consistent Technique for Constraining Nonlinear Signal Models
• Parametrizations of the global 21-cm signal and parameter estimation from single-dipole experiments
• Improving constraints on the reionization parameters using 21-cm bispectrum
• 21cmVAE: A Very Accurate Emulator of the 21-cm Global Signal
• Global 21-cm signal extraction from foreground and instrumental effects IV: Accounting for realistic instrument uncertainties and their overlap with foreground and signal models
• Extracting cosmological parameters from N-body simulations using machine learning techniques
• Selection between foreground models for global 21-cm experiments
• Measuring the Hubble Constant with cosmic chronometers: a machine learning approach
• Using Artificial Neural Networks to extract the 21-cm Global Signal from the EDGES data
• Extracting the Global 21-cm signal from Cosmic Dawn and Epoch of Reionization in the presence of Foreground and Ionosphere
• A fast method of reionization parameter space exploration using GPR trained SCRIPT
• Comparing sampling techniques to chart parameter space of 21 cm Global signal with Artificial Neural Networks
• Detecting Cosmic 21 cm Global Signal Using an Improved Polynomial Fitting Algorithm
• Accelerating HI density predictions during the Epoch of Reionization using a GPR-based emulator on N-body simulations