FastPM: a new scheme for fast simulations of dark matter and halos

Abstract

We introduce FastPM, a highly-scalable approximated particle mesh N-body solver, which implements the particle mesh (PM) scheme enforcing correct linear displacement (1LPT) evolution via modified kick and drift factors. Employing a 2-dimensional domain decomposing scheme, FastPM scales extremely well with a very large number of CPUs. In contrast to COmoving-LAgrangian (COLA) approach, we do not require to split the force or track separately the 2LPT solution, reducing the code complexity and memory requirements. We compare FastPM with different number of steps ($N_s$) and force resolution factor ($B$) against 3 benchmarks: halo mass function from Friends of Friends halo finder, halo and dark matter power spectrum, and cross correlation coefficient (or stochasticity), relative to a high resolution TreePM simulation. We show that the modified time stepping scheme reduces the halo stochasticity when compared to COLA with the same number of steps and force resolution. While increasing $N_s$ and $B$ improves the transfer function and cross correlation coefficient, for many applications FastPM achieves sufficient accuracy at low $N_s$ and $B$. For example, $N_s=10$ and $B=2$ simulation provides a substantial saving (a factor of 10) of computing time relative to $N_s=40$, $B=3$ simulation, yet the halo benchmarks are very similar at $z=0$. We find that for abundance matched halos the stochasticity remains low even for $N_s=5$. FastPM compares well against less expensive schemes, being only 7 (4) times more expensive than 2LPT initial condition generator for $N_s=10$ ($N_s=5$). Some of the applications where FastPM can be useful are generating a large number of mocks, producing non-linear statistics where one varies a large number of nuisance or cosmological parameters, or serving as part of an initial conditions solver.

14 pages, 13 figures. The development is hosted at https://github.com/rainwoodman/fastpm . Major revision addressing referee report from MNRAS; Update code repository URL in comments

References in corpus (7)

• The Halo Mass Function: High-Redshift Evolution and Universality
• A critical look at cosmological perturbation theory techniques
• P3DFFT: a framework for parallel computations of Fourier transforms in three dimensions
• The Cosmic Code Comparison Project
• Towards optimal parallel PM N-body codes: PMFAST
• Halo Zeldovich model and perturbation theory: dark matter power spectrum and correlation function
• Simulations of Baryon Acoustic Oscillations I: Growth of Large-Scale Density Fluctuations

Cited by in corpus (158)

• The Quijote simulations
• nbodykit: an open-source, massively parallel toolkit for large-scale structure
• Learning to Predict the Cosmological Structure Formation
• Large-scale dark matter simulations
• The $\text{Abacus}$ Cosmological $N$-body Code
• The ASTRID Simulation: Galaxy Formation and Reionization
• The completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: 1000 multi-tracer mock catalogues with redshift evolution and systematics for galaxies and quasars of the final data release
• Cosmological constraints from unWISE and Planck CMB lensing tomography
• The Websky Extragalactic CMB Simulations
• Iterative initial condition reconstruction
• The DAWES review 10: The impact of deep learning for the analysis of galaxy surveys
• AI-assisted super-resolution cosmological simulations
• The mass-Peak Patch algorithm for fast generation of deep all-sky dark matter halo catalogues and its N-Body validation
• The information content in cold stellar streams
• The cosmology dependence of galaxy clustering and lensing from a hybrid $N$-body-perturbation theory model
• UNIT project: Universe $N$-body simulations for the Investigation of Theoretical models from galaxy surveys
• Comparing approximate methods for mock catalogues and covariance matrices II: Power spectrum multipoles
• Simulations and symmetries
• The MillenniumTNG Project: High-precision predictions for matter clustering and halo statistics
• Cosmological Reconstruction From Galaxy Light: Neural Network Based Light-Matter Connection
• Dark matter statistics for large galaxy catalogs: power spectra and covariance matrices
• Improving fast generation of halo catalogs with higher-order Lagrangian perturbation theory
• Halo bias in Lagrangian Space: Estimators and theoretical predictions
• Statistical properties of paired fixed fields
• Reconstructing large-scale structure with neutral hydrogen surveys
• Inflation and Early Dark Energy with a Stage II Hydrogen Intensity Mapping Experiment
• Theoretical Systematics of Future Baryon Acoustic Oscillation Surveys
• CARPool: fast, accurate computation of large-scale structure statistics by pairing costly and cheap cosmological simulations
• A volumetric deep Convolutional Neural Network for simulation of mock dark matter halo catalogues
• The Atacama Cosmology Telescope: Cosmology from cross-correlations of unWISE galaxies and ACT DR6 CMB lensing
• Translation and Rotation Equivariant Normalizing Flow (TRENF) for Optimal Cosmological Analysis
• FlowPM: Distributed TensorFlow Implementation of the FastPM Cosmological N-body Solver
• Cosmic voids: a novel probe to shed light on our Universe
• COSMIC BIRTH: Efficient Bayesian Inference of the Evolving Cosmic Web from Galaxy Surveys
• Field Level Neural Network Emulator for Cosmological N-body Simulations
• Efficient Computation of Galaxy Bias with Neutrinos and Other Relics
• FORGE -- the f(R) gravity cosmic emulator project I: Introduction and matter power spectrum emulator
• TARDIS Paper I: A Constrained Reconstruction Approach to Modeling the z~2.5 Cosmic Web Probed by Lyman-alpha Forest Tomography
• Learning effective physical laws for generating cosmological hydrodynamics with Lagrangian Deep Learning
• Correlations between Triaxial Shapes and Formation History of Dark Matter Haloes
• Aemulus $\nu$: Precise Predictions for Matter and Biased Tracer Power Spectra in the Presence of Neutrinos
• A fast particle-mesh simulation of non-linear cosmological structure formation with massive neutrinos
• BAM: Bias Assignment Method to generate mock catalogs
• Cosmological parameter estimation via iterative emulation of likelihoods
• Fast full N-body simulations of generic modified gravity: conformal coupling models
• Intensity mapping with neutral hydrogen and the Hidden Valley simulations
• Precision Tests of CO and [CII] Power Spectra Models against Simulated Intensity Maps
• Non-perturbative probability distribution function for cosmological counts in cells
• A gradient based method for modeling baryons and matter in halos of fast simulations
• Large-scale structure perturbation theory without losing stream crossing
• CoLoRe: fast cosmological realisations over large volumes with multiple tracers
• ICE-COLA: fast simulations for weak lensing observables
• The DESI $N$-body Simulation Project I: Testing the Robustness of Simulations for the DESI Dark Time Survey
• $\mathrm{S}\mathrm{IM}\mathrm{BIG}$: Mock Challenge for a Forward Modeling Approach to Galaxy Clustering
• Fast full $N$-body simulations of generic modified gravity: derivative coupling models
• Towards a Deep Learning Model for Hadronization
• Accurate predictions from small boxes: variance suppression via the Zel'dovich approximation
• Prediction of H$\alpha$ and [OIII] Emission Line Galaxy Number Counts for Future Galaxy Redshift Surveys
• PRIYA: A New Suite of Lyman-alpha Forest Simulations for Cosmology
• Semiclassical path to cosmic large-scale structure
• Exploring the posterior surface of the large scale structure reconstruction
• Nonlinear 3D Cosmic Web Simulation with Heavy-Tailed Generative Adversarial Networks
• Precision Redshift-Space Galaxy Power Spectra using Zel'dovich Control Variates
• The DESI $N$-body Simulation Project -- II. Suppressing sample variance with fast simulations
• Modeling HI at the field level
• Simulating cosmologies beyond $\Lambda$CDM with PINOCCHIO
• Suppressing cosmic variance with paired-and-fixed cosmological simulations: average properties and covariances of dark matter clustering statistics
• Bayesian Inference of Initial Conditions from Non-Linear Cosmic Structures using Field-Level Emulators
• Cylinders out of a top hat: counts-in-cells for projected densities
• CSST Cosmological Emulator I: Matter Power Spectrum Emulation with one percent accuracy to k = 10 h/Mpc
• Joint velocity and density reconstruction of the Universe with nonlinear differentiable forward modeling
• Enabling matter power spectrum emulation in beyond-$\Lambda$CDM cosmologies with COLA
• The bias of dark matter tracers: assessing the accuracy of mapping techniques
• TARDIS Paper II: Synergistic Density Reconstruction from Lyman-alpha Forest and Spectroscopic Galaxy Surveys with Applications to Protoclusters and the Cosmic Web
• BEoRN: A fast and flexible framework to simulate the epoch of reionisation and cosmic dawn
• Cosmological Vlasov-Poisson equations for dark matter: Recent developments and connections to selected plasma problems
• PNG-UNITsims: Halo clustering response to primordial non-Gaussianities as a function of mass
• One simulation to have them all: performance of the Bias Assignment Method against N-body simulations
• An Analytic Hybrid Halo + Perturbation Theory Model for Small-scale Correlators: Baryons, Halos, and Galaxies
• Fast and Accurate Non-Linear Predictions of Universes with Deep Learning
• The early growth of supermassive black holes in cosmological hydrodynamic simulations with constrained Gaussian realizations
• Does jackknife scale really matter for accurate large-scale structure covariances?
• Testing approximate predictions of displacements of cosmological dark matter halos
• Differentiable Cosmological Simulation with Adjoint Method
• Fast and realistic large-scale structure from machine-learning-augmented random field simulations
• Accurate Baryon Acoustic Oscillations reconstruction via semi-discrete optimal transport
• Towards Accurate Field-Level Inference of Massive Cosmic Structures
• High mass and halo resolution from fast low resolution simulations
• Accurate halo-galaxy mocks from automatic bias estimation and particle mesh gravity solvers
• Mitigating the noise of DESI mocks using analytic control variates
• Super-sample covariance of the power spectrum, bispectrum, halos, voids, and their cross covariances
• Cosmological Probes of Structure Growth and Tests of Gravity
• Mapping Lyman-alpha forest three-dimensional large scale structure in real and redshift space
• Robustness of the covariance matrix for galaxy clustering measurements
• Optimizing simulation parameters for weak lensing analyses involving non-Gaussian observables
• Fitting covariance matrix models to simulations
• Reconstructing the Universe with Variational self-Boosted Sampling
• Halo mass and weak galaxy-galaxy lensing profiles in rescaled cosmological $N$-body simulations
• Sesame: A power spectrum emulator pipeline for beyond-$\Lambda$CDM models
• Constrained cosmological simulations of the Local Group using Bayesian hierarchical field-level inference
• HI intensity mapping correlation function from UNIT simulations: BAO and observationally induced anisotropy
• Bayesian Control Variates for optimal covariance estimation with pairs of simulations and surrogates
• On the primordial information available to galaxy redshift surveys
• Rapid Simulations of Halo and Subhalo Clustering
• $\text{PineTree}$: A generative, fast, and differentiable halo model for wide-field galaxy surveys
• The HalfDome Multi-Survey Cosmological Simulations: N-body Simulations
• BullFrog: Multi-step perturbation theory as a time integrator for cosmological simulations
• Validating galaxy clustering models with Fixed & Paired and Matched-ICs simulations: application to Primordial Non-Gaussianities
• The 2-point correlation function covariance with fewer mocks
• A field-level emulator for modified gravity
• Renormalization group and UV completion of cosmological perturbations: Gravitational collapse as a critical phenomenon
• A Machine Learning Approach to Correct for Mass Resolution Effects in Simulated Halo Clustering Statistics
• CosmicRIM : Reconstructing Early Universe by Combining Differentiable Simulations with Recurrent Inference Machines
• Accurate relativistic observables from post-processing light cone catalogues
• Weak Lensing Magnification Reconstruction with the Modified Internal Linear Combination Method
• MultiCAM: A multivariable framework for connecting the mass accretion history of haloes with their properties
• Perturbation-theory informed integrators for cosmological simulations
• Euclid preparation. Simulating thousands of Euclid spectroscopic skies
• Differentiable Cosmological Hydrodynamics for Field-Level Inference and High Dimensional Parameter Constraints
• COmoving Computer Acceleration (COCA): $N$-body simulations in an emulated frame of reference
• DESI Mock Challenge: Constructing DESI galaxy catalogues based on FastPM simulations
• Covariance matrices for variance-suppressed simulations
• Secondary halo bias through cosmic time II: Reconstructing halo properties using clustering information
• Starting Cosmological Simulations from the Big Bang
• The bias from hydrodynamic simulations: mapping baryon physics onto dark matter fields
• Fast simulation mapping: from standard to modified gravity cosmologies using the bias assignment method
• Introducing cosmosTNG: simulating galaxy formation with constrained realizations of the COSMOS field
• Fast and accurate collapse-time predictions for collisionless matter
• Learning the Universe: Learning to Optimize Cosmic Initial Conditions with Non-Differentiable Structure Formation Models
• Including relativistic and primordial Non-Gaussianity contributions in cosmological simulations by modifying the initial condition
• Mind the gap: the power of combining photometric surveys with intensity mapping
• Cosmological Constraints with Void Lensing I: the Simulation-Based Inference Framework
• Renormalization group computation of likelihood functions for cosmological data sets
• Stochastic Super-resolution of Cosmological Simulations with Denoising Diffusion Models
• Modelling the covariance matrix for the power spectra before and after the BAO reconstruction
• PySCo: A fast Particle-Mesh $N$-body code for modified gravity simulations in Python
• A Conditional Abundance Matching Method of Extending Simulated Halo Merger Trees to Resolve Low-Mass Progenitors and Sub-halos
• Optical Confirmation of X-ray selected Galaxy clusters from the Swift AGN and Cluster survey with MDM and Pan-STARRS Data (Paper III)
• Constraining primordial non-Gaussianity from the large scale structure two-point and three-point correlation functions
• Improving the Accuracy of Halo Mass Based Statistics For Fast Approximate N-body Simulations
• Improved renormalization group computation of likelihood functions for cosmological data sets
• Towards an optimal extraction of cosmological parameters from galaxy cluster surveys using convolutional neural networks
• JERALD: high-fidelity dark matter, stellar mass and neutral hydrogen maps from fast N-body simulations
• A Hydro-Particle-Mesh Code for Efficient and Rapid Simulations of the Intracluster Medium
• A fast algorithm for identifying Friends-of-Friends halos
• Learning from Topology: Cosmological Parameter Estimation from the Large-scale Structure
• Impact of a Rapid Diluted Energy Density on the halo mass function
• MADLens, a python package for fast and differentiable non-Gaussian lensing simulations
• The multi-dimensional halo assembly bias can be preserved when enhancing halo properties with HALOSCOPE
• Generative modeling of convergence maps based on predicted one-point statistics
• Differentiable Fuzzy Cosmic-Web for Field Level Inference
• Fast Baryonic Field Painting for Sunyaev-Zel'dovich Analyses: Transfer Function vs. Hybrid Effective Field Theory
• Iterative reconstruction excursions for Baryon Acoustic Oscillations and beyond
• Cosmological Analysis with Calibrated Neural Quantile Estimation and Approximate Simulators
• FLARE MCMC: Fidelity-based Layer-Adaptive REcursive proposals for MCMC
• Benchmarking field-level cosmological inference from galaxy redshift surveys
• ELUCID-DESI I: A Parallel MPI Implementation of the Initial Condition Solver for Large-Scale Reconstruction Simulations
• Beyond the two-point correlation: constraining primordial non-gaussianity with density perturbation moments