Solving Large Scale Structure in Ten Easy Steps with COLA

Abstract

We present the COmoving Lagrangian Acceleration (COLA) method: an N-body method for solving for Large Scale Structure (LSS) in a frame that is comoving with observers following trajectories calculated in Lagrangian Perturbation Theory (LPT). Unlike standard N-body methods, the COLA method can straightforwardly trade accuracy at small-scales in order to gain computational speed without sacrificing accuracy at large scales. This is especially useful for cheaply generating large ensembles of accurate mock halo catalogs required to study galaxy clustering and weak lensing, as those catalogs are essential for performing detailed error analysis for ongoing and future surveys of LSS. As an illustration, we ran a COLA-based N-body code on a box of size 100Mpc/h with particles of mass ~5*10^9Msolar/h. Running the code with only 10 timesteps was sufficient to obtain an accurate description of halo statistics down to halo masses of at least 10^11Msolar/h. This is only at a modest speed penalty when compared to mocks obtained with LPT. A standard detailed N-body run is orders of magnitude slower than our COLA-based code. The speed-up we obtain with COLA is due to the fact that we calculate the large-scale dynamics exactly using LPT, while letting the N-body code solve for the small scales, without requiring it to capture exactly the internal dynamics of halos. Achieving a similar level of accuracy in halo statistics without the COLA method requires at least 3 times more timesteps than when COLA is employed.

18 pages, 7 figures

References in corpus (5)

• A 2% Distance to z=0.35 by Reconstructing Baryon Acoustic Oscillations - I : Methods and Application to the Sloan Digital Sky Survey
• The clustering of galaxies in the SDSS-III Baryon Oscillation Spectroscopic Survey: a large sample of mock galaxy catalogues
• The Mildly Non-Linear Regime of Structure Formation
• Towards an Optimal Reconstruction of Baryon Oscillations
• Estimating CDM Particle Trajectories in the Mildly Non-Linear Regime of Structure Formation. Implications for the Density Field in Real and Redshift Space

Cited by in corpus (275)

• The Clustering of the SDSS DR7 Main Galaxy Sample I: A 4 per cent Distance Measure at z=0.15
• The Effective Field Theorist's Approach to Gravitational Dynamics
• The WiggleZ Dark Energy Survey: Improved Distance Measurements to z = 1 with Reconstruction of the Baryonic Acoustic Feature
• The clustering of galaxies in the SDSS-III Baryon Oscillation Spectroscopic Survey: mock galaxy catalogues for the BOSS Final Data Release
• The Clustering of the SDSS Main Galaxy Sample II: Mock galaxy catalogues and a measurement of the growth of structure from Redshift Space Distortions at $z=0.15$
• nbodykit: an open-source, massively parallel toolkit for large-scale structure
• Fast likelihood-free cosmology with neural density estimators and active learning
• FastPM: a new scheme for fast simulations of dark matter and halos
• Ingredients for 21cm intensity mapping
• EZmocks: extending the Zel'dovich approximation to generate mock galaxy catalogues with accurate clustering statistics
• Cosmological $N$-body simulations with suppressed variance
• Mock galaxy catalogs using the quick particle mesh method
• Modelling Baryon Acoustic Oscillations with Perturbation Theory and Stochastic Halo Biasing
• Large-scale dark matter simulations
• The $\text{Abacus}$ Cosmological $N$-body Code
• Likelihood-free inference with neural compression of DES SV weak lensing map statistics
• The completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: 1000 multi-tracer mock catalogues with redshift evolution and systematics for galaxies and quasars of the final data release
• Galaxy Power Spectrum Multipoles Covariance in Perturbation Theory
• The Websky Extragalactic CMB Simulations
• Cosmic flows in the nearby Universe: new peculiar velocities from SNe and cosmological constraints
• Dark Energy Survey Year 3 Results: A 2.7% measurement of Baryon Acoustic Oscillation distance scale at redshift 0.835
• Cosmological constraints from BOSS with analytic covariance matrices
• Low Redshift Baryon Acoustic Oscillation Measurement from the Reconstructed 6-degree Field Galaxy Survey
• The Abacus Cosmos: A Suite of Cosmological N-body Simulations
• The DAWES review 10: The impact of deep learning for the analysis of galaxy surveys
• ICE-COLA: Towards fast and accurate synthetic galaxy catalogues optimizing a quasi $N$-body method
• The mass-Peak Patch algorithm for fast generation of deep all-sky dark matter halo catalogues and its N-Body validation
• COLA with scale-dependent growth: applications to screened modified gravity models
• The Novel Probes Project -- Tests of Gravity on Astrophysical Scales
• Eulerian BAO Reconstructions and N-Point Statistics
• UNIT project: Universe $N$-body simulations for the Investigation of Theoretical models from galaxy surveys
• Comparing approximate methods for mock catalogues and covariance matrices II: Power spectrum multipoles
• Comparing approximate methods for mock catalogues and covariance matrices I: correlation function
• nIFTy Cosmology: Galaxy/halo mock catalogue comparison project on clustering statistics
• Fast and accurate mock catalogue generation for low-mass galaxies
• Lagrangian perturbation theory at one loop order: successes, failures, and improvements
• Dark matter statistics for large galaxy catalogs: power spectra and covariance matrices
• Fast simulations for intensity mapping experiments
• The BOSS-WiggleZ overlap region I: Baryon Acoustic Oscillations
• Improving fast generation of halo catalogs with higher-order Lagrangian perturbation theory
• The clustering of galaxies in the SDSS-III Baryon Oscillation Spectroscopic Survey: mock galaxy catalogues for the low-redshift sample
• Deep learning dark matter map reconstructions from DES SV weak lensing data
• Generating Log-normal Mock Catalog of Galaxies in Redshift Space
• Statistical properties of paired fixed fields
• Bayesian analysis of the dynamic cosmic web in the SDSS galaxy survey
• Efficient simulations of large scale structure in modified gravity cosmologies with comoving Lagrangian acceleration
• Inflation and Early Dark Energy with a Stage II Hydrogen Intensity Mapping Experiment
• The BACCO simulation project: biased tracers in real space
• Fast and Credible Likelihood-Free Cosmology with Truncated Marginal Neural Ratio Estimation
• Matter Power Spectrum Emulator for f(R) Modified Gravity Cosmologies
• Lifting weak lensing degeneracies with a field-based likelihood
• COLA with massive neutrinos
• CARPool: fast, accurate computation of large-scale structure statistics by pairing costly and cheap cosmological simulations
• Lagrangian or Eulerian; Real or Fourier? Not All Approaches to Large-Scale Structure Are Created Equal
• A volumetric deep Convolutional Neural Network for simulation of mock dark matter halo catalogues
• Searching for Modified Gravity: Scale and Redshift Dependent Constraints from Galaxy Peculiar Velocities
• LyaCoLoRe: Synthetic Datasets for Current and Future Lyman-$\alpha$ Forest BAO Surveys
• Improving the precision matrix for precision cosmology
• Solving the Vlasov equation in two spatial dimensions with the Schrödinger method
• FlowPM: Distributed TensorFlow Implementation of the FastPM Cosmological N-body Solver
• Cosmic voids: a novel probe to shed light on our Universe
• COSMIC BIRTH: Efficient Bayesian Inference of the Evolving Cosmic Web from Galaxy Surveys
• Field Level Neural Network Emulator for Cosmological N-body Simulations
• Efficient Computation of Galaxy Bias with Neutrinos and Other Relics
• Lagrangian perturbation theory for modified gravity
• A Fast Route to Non-Linear Clustering Statistics in Modified Gravity Theories
• Joint growth rate measurements from redshift-space distortions and peculiar velocities in the 6dF Galaxy Survey
• FORGE -- the f(R) gravity cosmic emulator project I: Introduction and matter power spectrum emulator
• Testing Gravity on Cosmic Scales: A Case Study of Jordan-Brans-Dicke Theory
• Learning effective physical laws for generating cosmological hydrodynamics with Lagrangian Deep Learning
• Dark Energy Survey Year 1 Results: galaxy mock catalogues for BAO
• ADDGALS: Simulated Sky Catalogs for Wide Field Galaxy Surveys
• The one-loop matter bispectrum as a probe of gravity and dark energy
• The Q Continuum Simulation: Harnessing the Power of GPU Accelerated Supercomputers
• Density distribution of the cosmological matter field
• A fast particle-mesh simulation of non-linear cosmological structure formation with massive neutrinos
• Efficient exploration of cosmology dependence in the EFT of LSS
• Voronoi volume function: A new probe of cosmology and galaxy evolution
• Bayesian forward modelling of cosmic shear data
• BAM: Bias Assignment Method to generate mock catalogs
• Cosmological constraints on the gravitational constant
• Fast full N-body simulations of generic modified gravity: conformal coupling models
• A gradient based method for modeling baryons and matter in halos of fast simulations
• The foreground transfer function for HI intensity mapping signal reconstruction: MeerKLASS and precision cosmology applications
• An accurate perturbative approach to redshift space clustering of biased tracers in modified gravity
• The effect of photometric redshift uncertainties on galaxy clustering and baryonic acoustic oscillations
• ICE-COLA: fast simulations for weak lensing observables
• Estimating the power spectrum covariance matrix with fewer mock samples
• CoLoRe: fast cosmological realisations over large volumes with multiple tracers
• Beyond delta: Tailoring marked statistics to reveal modified gravity
• One-point remapping of Lagrangian perturbation theory in the mildly non-linear regime of cosmic structure formation
• Non-linear contributions to angular power spectra
• The BOSS-WiggleZ overlap region II: dependence of cosmic growth on galaxy type
• Fast full $N$-body simulations of generic modified gravity: derivative coupling models
• Beyond two-point statistics: using the minimum spanning tree as a tool for cosmology
• sCOLA: The N-body COLA Method Extended to the Spatial Domain
• Accurate predictions from small boxes: variance suppression via the Zel'dovich approximation
• How does non-linear dynamics affect the baryon acoustic oscillation?
• Remapping dark matter halo catalogues between cosmological simulations
• NECOLA: Towards a Universal Field-level Cosmological Emulator
• Investigating the degeneracy between modified gravity and massive neutrinos with redshift-space distortions
• BAO reconstruction: a swift numerical action method for massive spectroscopic surveys
• Nonlinear 3D Cosmic Web Simulation with Heavy-Tailed Generative Adversarial Networks
• Semiclassical path to cosmic large-scale structure
• Extracting bias using the cross-bispectrum: An EoR and 21 cm-[CII]-[CII] case study
• Euclid: The search for primordial features
• Measuring the evolution of intergalactic gas from z=0 to 5 using the kinematic Sunyaev-Zel'dovich effect
• Fast Generation of Covariance Matrices for Weak Lensing
• Improving reconstruction of the baryon acoustic peak : the effect of local environment
• $\text{Hi-COLA}$: Fast, approximate simulations of structure formation in Horndeski gravity
• The locations of halo formation and the peaks formalism
• The Halo Void (Dust) Model of Large Scale Structure
• Truthing the stretch: Non-perturbative cosmological realizations with multiscale spherical collapse
• Euclid: Modelling massive neutrinos in cosmology -- a code comparison
• Modeling HI at the field level
• Helmholtz Decomposition of the Lagrangian Displacement
• Simulating cosmologies beyond $\Lambda$CDM with PINOCCHIO
• The DESI $N$-body Simulation Project -- II. Suppressing sample variance with fast simulations
• The halo light cone catalogues of \Abacus{AbacusSummit}
• Signatures of Cosmic Reionization on the 21cm 2- and 3-point Correlation Function I: Quadratic Bias Modeling
• Bayesian Inference of Initial Conditions from Non-Linear Cosmic Structures using Field-Level Emulators
• Convolution Lagrangian perturbation theory for biased tracers beyond general relativity
• Taking measurements of the kinematic Sunyaev-Zel'dovich effect forward: including uncertainties from velocity reconstruction with forward modeling
• CosmoFlow: Using Deep Learning to Learn the Universe at Scale
• Enabling matter power spectrum emulation in beyond-$\Lambda$CDM cosmologies with COLA
• Cosmic Velocity Field Reconstruction Using AI
• Encoding large scale cosmological structure with Generative Adversarial Networks
• The bias of dark matter tracers: assessing the accuracy of mapping techniques
• Modelling galaxy clustering in redshift space with a Lagrangian bias formalism and $N$-body simulations
• Impact of bias and redshift-space modelling for the halo power spectrum: Testing the effective field theory of large-scale structure
• CMB Distortions from Damping of Acoustic Waves Produced by Cosmic Strings
• Bayesian cosmic density field inference from redshift space dark matter maps
• Euclid preparation. XLI. Galaxy power spectrum modelling in real space
• N-point Statistics of Large-Scale Structure in the Zel'dovich Approximation
• Cosmological Vlasov-Poisson equations for dark matter: Recent developments and connections to selected plasma problems
• (DarkAI) Mapping the large-scale density field of dark matter using artificial intelligence
• Investigating Cosmological GAN Emulators Using Latent Space Interpolation
• An Analytic Hybrid Halo + Perturbation Theory Model for Small-scale Correlators: Baryons, Halos, and Galaxies
• Comparing cosmic web classifiers using information theory
• Cosmological parameter inference from galaxy clustering: The effect of the posterior distribution of the power spectrum
• Fast generation of mock galaxy catalogues in modified gravity models with COLA
• Studying large-scale structure probes of modified gravity with COLA
• Fast and Accurate Non-Linear Predictions of Universes with Deep Learning
• Does jackknife scale really matter for accurate large-scale structure covariances?
• Primordial power spectrum and cosmology from black-box galaxy surveys
• Testing approximate predictions of displacements of cosmological dark matter halos
• Using Lagrangian perturbation theory for precision cosmology
• Dark Energy Survey Year 3 Results: Measurement of the Baryon Acoustic Oscillations with Three-dimensional Clustering
• Fast and realistic large-scale structure from machine-learning-augmented random field simulations
• COVMOS: a new Monte Carlo approach for galaxy clustering analysis
• High mass and halo resolution from fast low resolution simulations
• Euclid: Constraining linearly scale-independent modifications of gravity with the spectroscopic and photometric primary probes
• Estimating Cosmological Parameters from the Dark Matter Distribution
• Simulated reconstruction of the remote dipole field using the kinetic Sunyaev Zel'dovich effect
• Towards Accurate Field-Level Inference of Massive Cosmic Structures
• Clustering with general photo-$z$ uncertainties: Application to Baryon Acoustic Oscillations
• Cosmological Probes of Structure Growth and Tests of Gravity
• Robustness of the covariance matrix for galaxy clustering measurements
• Reconstructing dark matter distribution with peculiar velocities: Bayesian forward modelling with corrections for inhomogeneous Malmquist bias
• Mapping Lyman-alpha forest three-dimensional large scale structure in real and redshift space
• Beyond the growth rate of cosmic structure: Testing modified gravity models with an extra degree of freedom
• Cosmic Flow Measurement and Mock Sampling Algorithm of Cosmicflows-4 Tully-Fisher Catalogue
• Improving estimates of the growth rate using galaxy-velocity correlations: a simulation study
• Reconstructing the Universe with Variational self-Boosted Sampling
• Sesame: A power spectrum emulator pipeline for beyond-$\Lambda$CDM models
• Tomographic Constraints on Gravity from Angular Redshift Fluctuations in the Late Universe
• Density Weighted Angular Redshift Fluctuations: a New Cosmological Observable
• Extracting high-order cosmological information in galaxy surveys with power spectra
• Fast generation of weak lensing maps by the inverse-Gaussianization method
• Planting a Lyman alpha forest on AbacusSummit
• Constrained cosmological simulations of the Local Group using Bayesian hierarchical field-level inference
• Efficient Construction of Mock Catalogs for Baryon Acoustic Oscillation Surveys
• Perfectly parallel cosmological simulations using spatial comoving Lagrangian acceleration
• Improved analytical modeling of the non-linear power spectrum in modified gravity cosmologies
• How accurately can we measure the baryon acoustic oscillation feature?
• Assessing non-linear models for galaxy clustering II: model validation and forecasts for Stage IV surveys
• Mock halo catalogs: assigning unresolved halo properties using correlations with local halo environment
• Uneven flows: On cosmic bulk flows, local observers, and gravity
• Bayesian Control Variates for optimal covariance estimation with pairs of simulations and surrogates
• Assessing non-linear models for galaxy clustering III: Theoretical accuracy for Stage IV surveys
• On the primordial information available to galaxy redshift surveys
• Revisiting Vainshtein Screening for fast N-body simulations
• On the primordial origin of the smoothing excess in the $Planck$ temperature power spectrum in light of LSS data
• Quijote-PNG: Quasi-maximum likelihood estimation of Primordial Non-Gaussianity in the non-linear halo density field
• Rapid Simulations of Halo and Subhalo Clustering
• $\text{PineTree}$: A generative, fast, and differentiable halo model for wide-field galaxy surveys
• Constraining $f(R)$ Gravity with a $k$-cut Cosmic Shear Analysis of the Hyper Suprime-Cam First-Year Data
• Using the Mark Weighted Correlation Functions to Improve the Constraints on Cosmological Parameters
• Fast numerical method to generate halo catalogs in modified gravity (part I): second-order Lagrangian Perturbation Theory
• Fast generation of mock galaxy catalogues with COLA
• One-point statistics of the Lagrangian displacement field
• Simple lessons from complex learning: what a neural network model learns about cosmic structure formation
• MUSCLE-UPS: Improved Approximations of the Matter Field with the Extended Press-Schechter Formalism and Lagrangian Perturbation Theory
• Hitting the mark: Optimising Marked Power Spectra for Cosmology
• Choose to smooth: Gaussian streaming with the truncated Zel'dovich approximation
• BullFrog: Multi-step perturbation theory as a time integrator for cosmological simulations
• Validating galaxy clustering models with Fixed & Paired and Matched-ICs simulations: application to Primordial Non-Gaussianities
• Scale-Dependent Gravitational Couplings in Parameterised Post-Newtonian Cosmology
• The 2-point correlation function covariance with fewer mocks
• Cosmological Constraints from Fourier Phase Statistics
• A field-level emulator for modified gravity
• Non-linear Structure Formation for Dark Energy Models with a Steep Equation of State
• The importance of the cosmic web and halo substructure for power spectra
• Constraining modified gravity scenarios with the 6dFGS and SDSS galaxy peculiar velocity datasets
• Perturbation Theory Remixed: Improved Nonlinearity Modeling beyond Standard Perturbation Theory
• Beyond the Lognormal Approximation: a General Simulation Scheme
• Constraining the growth rate of structure with phase correlations
• Renormalization group and UV completion of cosmological perturbations: Gravitational collapse as a critical phenomenon
• Bayesian deep learning for cosmic volumes with modified gravity
• ScamPy -- A sub-halo clustering & abundance matching based Python interface for painting galaxies on the dark matter halo/sub-halo hierarchy
• Evaluating the variance of individual halo properties in constrained cosmological simulations
• Euclid preparation. Simulations and nonlinearities beyond $\Lambda$CDM. 1. Numerical methods and validation
• Cosmological constraints from the redshift dependence of the Alcock-Paczynski effect: Fourier space analysis
• Accurate relativistic observables from post-processing light cone catalogues
• MultiCAM: A multivariable framework for connecting the mass accretion history of haloes with their properties
• High-redshift Mini-haloes from Modulated Preheating
• Self-calibrating interloper bias in spectroscopic galaxy clustering surveys
• Non-linear matter power spectrum without screening dynamics modelling in $f(R)$ gravity
• Nonlinear cosmological structure with ultralight bosons via modified gravity
• Covariance matrices for variance-suppressed simulations
• Constrained simulations of the local Universe with Modified Gravity
• Cosmological constraints from the redshift dependence of the Alcock-Paczynski effect: Possibility of estimateing the non-linear systematics using fast simulations
• Perturbation-theory informed integrators for cosmological simulations
• Improving Constraint on ${\Omega }_m$ from SDSS Using Marked Correlation Functions
• Secondary halo bias through cosmic time II: Reconstructing halo properties using clustering information
• COmoving Computer Acceleration (COCA): $N$-body simulations in an emulated frame of reference
• Refining the nonlinear modelling of primordial oscillatory features
• Bayesian large-scale structure inference and cosmic web analysis
• Euclid preparation. Simulating thousands of Euclid spectroscopic skies
• Inferring Cosmological Parameters on SDSS via Domain-Generalized Neural Networks and Lightcone Simulations
• Neutrinos in N-body simulations
• Fast and accurate collapse-time predictions for collisionless matter
• Cosmological Perturbation Theory as a Tool for Estimating Box-Scale Effects in N-body Simulations
• The Velocity Field Olympics: Assessing velocity field reconstructions with direct distance tracers
• Including relativistic and primordial Non-Gaussianity contributions in cosmological simulations by modifying the initial condition
• Fast simulation mapping: from standard to modified gravity cosmologies using the bias assignment method
• Dynamic Zoom Simulations: a fast, adaptive algorithm for simulating lightcones
• The Low Redshift survey at Calar Alto (LoRCA)
• Improving SDSS cosmological constraints through $\beta$-skeleton weighted correlation functions
• Learning the Universe: Learning to Optimize Cosmic Initial Conditions with Non-Differentiable Structure Formation Models
• Signature of a Cosmic String Wake at $z=3$
• Optimizing Redshift Distribution Inference through Joint Self-Calibration and Clustering-Redshift Synergy
• Approximate methods for the generation of dark matter halo catalogs in the age of precision cosmology
• K-mouflage at high $k$: extending the reach of $\text{Hi-COLA}$
• An implementation of nDGP gravity in Pinocchio
• Improving the Accuracy of Halo Mass Based Statistics For Fast Approximate N-body Simulations
• A universal and physically motivated threshold for Hessian-based cosmic web identification: V-Web case
• Dark Energy Survey Year 3 Results: Galaxy mock catalogs for BAO analysis
• Fast Generation of Weak Lensing Maps in Modified Gravity with COLA
• JERALD: high-fidelity dark matter, stellar mass and neutral hydrogen maps from fast N-body simulations
• Emulating the Non-Linear Matter Power-Spectrum in Mixed Axion Dark Matter Models
• A Hydro-Particle-Mesh Code for Efficient and Rapid Simulations of the Intracluster Medium
• Towards an optimal extraction of cosmological parameters from galaxy cluster surveys using convolutional neural networks
• Testing and Emulating Modified Gravity on Cosmological Scales
• Kinetic field theory: generic effects of alternative gravity theories on non-linear cosmic density-fluctuations
• Obtaining non-linear galaxy bias constraints from galaxy-lensing phase differences
• Super sample covariance and the volume scaling of galaxy survey covariance matrices
• A preliminary study about gravitational wave radiation and cosmic heat death
• Seeing Wiggles without Seeing Wiggles: BAO Recovery in 21 cm Intensity Mapping with Deep Learning
• Generative modeling of convergence maps based on predicted one-point statistics
• Cosmological constraints from the density gradient weighted correlation function
• An Anti-halo Void Catalogue of the Local Super-Volume
• Variational autoencoder for generating realistic $N$-body simulations for dark matter halos
• Anisotropic Counts-in-Cells in Redshift Space: A New Route to Cosmological Constraints from Galaxy Surveys
• Probabilistic cartography of the large-scale structure
• Differentiable Fuzzy Cosmic-Web for Field Level Inference
• Hybrid $P_{\ell }(k)$: general, unified, non-linear matter power spectrum in redshift space
• nuGAN: Generative Adversarial Emulator for Cosmic Web with Neutrinos
• Cosmological Tests of Gravity
• Diagnosing Systematic Effects Using the Inferred Initial Power Spectrum
• Tomographic Alcock-Paczynski Test with Marked Correlation Functions
• Enhancing Cosmological Constraints by Two-dimensional $\beta$-cosmic-web Weighted Angular Correlation Functions
• The Manticore Project II: Bayesian digital twins of cosmic structure across the SDSS and BOSS volumes
• Predicting large scale cosmological structure evolution with generative adversarial network-based autoencoders
• A simple prediction of the nonlinear matter power spectrum in Brans-Dicke gravity from linear theory