CosmoUiT: A Vision Transformer-UNet Hybrid for Fast and Accurate Emulation of 21-cm Maps from the Epoch of Reionization
arXiv:2510.01121 · doi:10.1088/1475-7516/2026/06/011
Abstract
The observation of the redshifted 21-cm signal from the intergalactic medium will probe the epoch of reionization (EoR) with unprecedented detail. Various simulations are being developed and used to predict and understand the nature and morphology of this signal. However, these simulations are computationally very expensive and time-consuming to produce in large numbers. To overcome this problem, an efficient field-level emulator of this signal is required. However, the EoR 21-cm signal is highly non-Gaussian; therefore, capturing the correlations between different scales of this signal, which is directly related to the evolution of the reionization, with the neural network is quite difficult. Here, we introduce CosmoUiT, a UNet integrated vision transformer-based architecture, to overcome these difficulties. CosmoUiT emulates the 3D cubes of 21-cm signal from the EoR, for a given input dark matter density field, halo density field, and reionization parameters. CosmoUiT uses the multi-head self-attention mechanism of the transformer to capture the long-range dependencies and convolutional layers in the UNet to capture the small-scale variations in the target 21-cm field. Furthermore, the training of the emulator is conditioned on the input reionization parameters such that it gives a fast and accurate prediction of the 21-cm field for different sets of input reionization parameters. We evaluate the predictions of our emulator by comparing various statistics (e.g., bubble size distribution, power spectrum) and morphological features of the emulated and simulated maps. We further demonstrate that this vision transformer-based architecture can emulate the entire 3D 21-cm signal cube with high accuracy at both large and small scales.
arXiv commentPublished version; 38 pages, 23 figures, and 5 tables
References in corpus (48)
- Seven-Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Cosmological Interpretation
- Cosmology at Low Frequencies: The 21 cm Transition and the High-Redshift Universe
- Constraining the Evolution of the Ionizing Background and the Epoch of Reionization with z ~ 6 Quasars II: A Sample of 19 Quasars
- 21-cm cosmology
- Cosmic Reionization and Early Star-Forming Galaxies: A Joint Analysis of New Constraints from Planck and Hubble Space Telescope
- Statistics of 207 Lya Emitters at a Redshift Near 7: Constraints on Reionization and Galaxy Formation Models
- The Growth of HII Regions During Reionization
- Model-independent evidence in favor of an end to reionization by z~6
- Efficient Simulations of Early Structure Formation and Reionization
- A simulation calibrated limit on the HI power spectrum from the GMRT Epoch of Reionization experiment
- Improved upper limits on the 21-cm signal power spectrum of neutral hydrogen at from LOFAR
- C^2-Ray: A new method for photon-conserving transport of ionizing radiation
- First Results from HERA Phase I: Upper Limits on the Epoch of Reionization 21 cm Power Spectrum
- Inside-out or Outside-in: The topology of reionization in the photon-starved regime suggested by Lyman-alpha forest data
- HERA Phase I Limits on the Cosmic 21-cm Signal: Constraints on Astrophysics and Cosmology During the Epoch of Reionization
- The Cosmic Dawn and Epoch of Reionization with the Square Kilometre Array
- First Results from the Lyman Alpha Galaxies in the Epoch of Reionization (LAGER) Survey: Cosmological Reionization at z ~ 7
- The nature and evolution of the highly ionized near-zones in the absorption spectra of z~6 quasars
- Improving the Epoch of Reionization Power Spectrum Results from Murchison Widefield Array Season 1 Observations
- The first power spectrum limit on the 21-cm signal of neutral hydrogen during the Cosmic Dawn at z=20-25 from LOFAR
- Deep learning from 21-cm tomography of the Cosmic Dawn and Reionization
- The first (nearly) model-independent constraint on the neutral hydrogen fraction at z~5--6
- Emulation of reionization simulations for Bayesian inference of astrophysics parameters using neural networks
- On the use of semi-numerical simulations in predicting the 21-cm signal from the epoch of reionization
- Bubble size statistics during reionization from 21-cm tomography
- Constraining the astrophysics and cosmology from 21cm tomography using deep learning with the SKA
- Simulation-Based Inference of Reionization Parameters From 3D Tomographic 21 cm Lightcone Images
- The Distribution of Bubble Sizes During Reionization
- Statistics of the epoch of reionization (EoR) 21-cm signal -- II. The evolution of the power spectrum error-covariance
- The effect of non-Gaussianity on error predictions for the Epoch of Reionization (EoR) 21-cm power spectrum
- Evaluating machine learning techniques for predicting power spectra from reionization simulations
- Machine learning astrophysics from 21 cm lightcones: impact of network architectures and signal contamination
- HI Fluctuations at Large Redshifts: III - Simulating the Signal Expected at GMRT
- A deep learning model to emulate simulations of cosmic reionization
- Deep learning approach for identification of HII regions during reionization in 21-cm observations
- 21cmEMU: an emulator of 21cmFAST summary observables
- Improving constraints on the reionization parameters using 21-cm bispectrum
- Deeper multi-redshift upper limits on the Epoch of Reionization 21-cm signal power spectrum from LOFAR between z=8.3 and z=10.1
- Inferring Astrophysics and Dark Matter Properties from 21cm Tomography using Deep Learning
- Constraining the Reionization History using Bayesian Normalizing Flows
- Emulation of the Cosmic Dawn 21-cm Power Spectrum and Classification of Excess Radio Models Using an Artificial Neural Network
- pyCRay: A flexible and GPU-accelerated Radiative Transfer Framework for Simulating the Cosmic Epoch of Reionization
- Optimal, fast, and robust inference of reionization-era cosmology with the 21cmPIE-INN
- PINION: Physics-informed neural network for accelerating radiative transfer simulations for cosmic reionization
- SKATR: A Self-Supervised Summary Transformer for SKA
- First upper limits on the 21-cm signal power spectrum of neutral hydrogen at from the LOFAR 3C196 field
- From ANN to BNN: Inferring Reionization Parameters using Uncertainty-aware Emulators of 21-cm Summaries
- Large, fast and accurate HI intensity maps with latent overlap diffusion