Large, fast and accurate HI intensity maps with latent overlap diffusion
arXiv:2506.08086 · doi:10.1093/mnras/staf2071
Abstract
The distribution of 21 cm emission from neutral hydrogen is a powerful cosmological and astrophysical probe, as it traces the underlying dark matter and cold gas distributions throughout cosmic times. However, the prediction of observable signals is hindered by the large computational costs of the required hydrodynamic simulations. We introduce a novel machine learning pipeline that, once trained on a hydrodynamical simulation, is able to generate both halo mass density maps and the three-dimensional 21 cm brightness temperature signal, starting from a dark matter-only simulation. We use an attention-based ResUNet (HALO) to predict dark matter halo maps, which are then processed through a trained conditional variational diffusion model (LODI) to produce 21 cm brightness temperature maps. LODI is trained on smaller sub-volumes that are then seamlessly combined in 512-times larger volume using a new method, called `latent overlap'. We demonstrate that, once trained on 25^3 (Mpc/h)^3 volume simulations, we are able to predict the 21 cm power spectrum on an unseen dark matter map (with the same cosmology) to within 10% for wavenumbers k <= 10 h Mpc^-1, deep inside the non-linear regime, with a computational effort of the order of two minutes. While demonstrated on this specific volume, our approach is designed to be scalable to arbitrarily large simulations.
14 pages, 11 figures
References in corpus (52)
- Denoising Diffusion Probabilistic Models
- Nine-Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Cosmological Parameter Results
- Deep Residual Learning for Image Recognition
- The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: cosmological analysis of the DR12 galaxy sample
- Populating a cluster of galaxies - I. Results at z=0
- Cosmological SPH simulations: A hybrid multi-phase model for star formation
- Large Magellanic Cloud Cepheid Standards Provide a 1% Foundation for the Determination of the Hubble Constant and Stronger Evidence for Physics Beyond LambdaCDM
- Cosmology at Low Frequencies: The 21 cm Transition and the High-Redshift Universe
- Deep Unsupervised Learning using Nonequilibrium Thermodynamics
- Tensions between the Early and the Late Universe
- H0LiCOW XIII. A 2.4% measurement of from lensed quasars: tension between early and late-Universe probes
- GIZMO: A New Class of Accurate, Mesh-Free Hydrodynamic Simulation Methods
- 21-cm cosmology
- DESI DR2 Results II: Measurements of Baryon Acoustic Oscillations and Cosmological Constraints
- Beyond CDM: Problems, solutions, and the road ahead
- Cosmological Parameter Estimation Using 21 cm Radiation from the Epoch of Reionization
- The Arepo public code release
- Baryon Acoustic Oscillation Intensity Mapping as a Test of Dark Energy
- Measurement of 21 cm brightness fluctuations at z ~ 0.8 in cross-correlation
- Cosmology with Phase 1 of the Square Kilometre Array; Red Book 2018: Technical specifications and performance forecasts
- HI intensity mapping : a single dish approach
- Canadian Hydrogen Intensity Mapping Experiment (CHIME) Pathfinder
- Ingredients for 21cm intensity mapping
- Lack of clustering in low-redshift 21-cm intensity maps cross-correlated with 2dF galaxy densities
- The ALFALFA HI mass function: A dichotomy in the low-mass slope and a locally suppressed 'knee' mass
- HIRAX: A Probe of Dark Energy and Radio Transients
- Neutral hydrogen surveys for high redshift galaxy clusters and proto-clusters
- A ground-based 21cm Baryon acoustic oscillation survey
- HI intensity mapping with MeerKAT: power spectrum detection in cross-correlation with WiggleZ galaxies
- HI constraints from the cross-correlation of eBOSS galaxies and Green Bank Telescope intensity maps
- Detection of Cosmological 21 cm Emission with the Canadian Hydrogen Intensity Mapping Experiment
- HI intensity mapping with MeerKAT: Calibration pipeline for multi-dish autocorrelation observations
- Modeling the neutral hydrogen distribution in the post-reionization Universe: intensity mapping
- High-redshift post-reionization cosmology with 21cm intensity mapping
- Baryonic acoustic oscillations from 21cm intensity mapping: the Square Kilometre Array case
- The CAMELS Multifield Dataset: Learning the Universe's Fundamental Parameters with Artificial Intelligence
- Weighing neutrinos with cosmic neutral hydrogen
- The atomic Hydrogen content of the post-reionization Universe
- Constraining a halo model for cosmological neutral hydrogen
- Forecast for FAST: from Galaxies Survey to Intensity Mapping
- The HI content of dark matter halos at from ALFALFA
- The Atacama Cosmology Telescope: Summary of DR4 and DR5 Data Products and Data Access
- HIFlow: Generating Diverse HI Maps and Inferring Cosmology while Marginalizing over Astrophysics using Normalizing Flows
- HInet: Generating neutral hydrogen from dark matter with neural networks
- Detecting the power spectrum turnover with HI intensity mapping
- Modeling HI at the field level
- The problem of dust attenuation in photometric decomposition of edge-on galaxies and possible solutions
- Galaxy And Mass Assembly (GAMA): The group HI mass as a function of halo mass
- The HI Mass Function of the Local Universe: Combining Measurements from HIPASS, ALFALFA and FASHI
- Fast Simulation of Cosmological Neutral Hydrogen based on the Halo Model
- Emulating cosmological multifields with generative adversarial networks
- JERALD: high-fidelity dark matter, stellar mass and neutral hydrogen maps from fast N-body simulations