High Performance P3M N-body code: CUBEP3M
arXiv:1208.5098 · doi:10.1093/mnras/stt1591
Abstract
This paper presents CUBEP3M, a publicly-available high performance cosmological N-body code and describes many utilities and extensions that have been added to the standard package. These include a memory-light runtime SO halo finder, a non-Gaussian initial conditions generator, and a system of unique particle identification. CUBEP3M is fast, its accuracy is tuneable to optimize speed or memory, and has been run on more than 27,000 cores, achieving within a factor of two of ideal weak scaling even at this problem size. The code can be run in an extra-lean mode where the peak memory imprint for large runs is as low as 37 bytes per particles, which is almost two times leaner than other widely used N-body codes. However, load imbalances can increase this requirement by a factor of two, such that fast configurations with all the utilities enabled and load imbalances factored in require between 70 and 120 bytes per particles. CUBEP3M is well designed to study large scales cosmological systems, where imbalances are not too large and adaptive time-stepping not essential. It has already been used for a broad number of science applications that require either large samples of non-linear realizations or very large dark matter N-body simulations, including cosmological reionization, halo formation, baryonic acoustic oscillations, weak lensing or non-Gaussian statistics. We discuss the structure, the accuracy, known systematic effects and the scaling performance of the code and its utilities, when applicable.
20 pages, 17 figures, added halo profiles, updated to match MNRAS accepted version
References in corpus (15)
- Five-Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Cosmological Interpretation
- Cosmological Constraints from the SDSS Luminous Red Galaxies
- Revising the Halofit Model for the Nonlinear Matter Power Spectrum
- Measuring the Baryon Acoustic Oscillation scale using the SDSS and 2dFGRS
- CFHTLenS: The Canada-France-Hawaii Telescope Lensing Survey
- The halo mass function from the dark ages through the present day
- The halo mass function through the cosmic ages
- Radiative transfer simulations of cosmic reionization I: methodology and initial results
- Simulations of Baryon Acoustic Oscillations II: Covariance matrix of the matter power spectrum
- The 2dF Galaxy Redshift Survey: Final Data Release
- Signature of Primordial Non-Gaussianity on Matter Power Spectrum
- Cross-correlation Weak Lensing of SDSS Galaxy Clusters III: Mass-to-light Ratios
- Towards optimal parallel PM N-body codes: PMFAST
- Increasing the Fisher Information Content in the Matter Power Spectrum by Non-linear Wavelet Weiner Filtering
- Precision of diffuse 21-cm lensing
Cited by in corpus (125)
- Simulating cosmic structure formation with the GADGET-4 code
- KiDS-450 + 2dFLenS: Cosmological parameter constraints from weak gravitational lensing tomography and overlapping redshift-space galaxy clustering
- The halo mass function through the cosmic ages
- CFHTLenS revisited: assessing concordance with Planck including astrophysical systematics
- Cosmic microwave background bounds on primordial black holes including dark matter halo accretion
- Simulating cosmic reionization: How large a volume is large enough?
- Large-scale dark matter simulations
- Early Structure Formation in PBH Cosmologies
- 21 cm signal from cosmic dawn: Imprints of spin temperature fluctuations and peculiar velocities
- Constraining the intergalactic medium at 9.1 using LOFAR Epoch of Reionization observations
- SWIFT: A modern highly-parallel gravity and smoothed particle hydrodynamics solver for astrophysical and cosmological applications
- On the Use of Ly-alpha Emitters as Probes of Reionization
- The mass-Peak Patch algorithm for fast generation of deep all-sky dark matter halo catalogues and its N-Body validation
- On the use of semi-numerical simulations in predicting the 21-cm signal from the epoch of reionization
- Dark Sky Simulations: Early Data Release
- The 2-degree Field Lensing Survey: design and clustering measurements
- A massive blow for CDM the high redshift, mass, and collision velocity of the interacting galaxy cluster El Gordo contradicts concordance cosmology
- Cosmic Shear Cosmology Beyond 2-Point Statistics: A Combined Peak Count and Correlation Function Analysis of DES-Y1
- Cosmological Simulations for Combined-Probe Analyses: Covariance and Neighbour-Exclusion Bias
- Relativistic N-body simulations with massive neutrinos
- Bubble size statistics during reionization from 21-cm tomography
- Simulations of Weak Gravitational Lensing - II : Including Finite Support Effects in Cosmic Shear Covariance Matrices
- Light cone effect on the reionization 21-cm signal II: Evolution, anisotropies and observational implications
- Optimal identification of HII regions during reionization in 21-cm observations
- The 21cm bispectrum as a probe of non-Gaussianities due to X-ray heating
- Imaging the redshifted 21-cm pattern around the first sources during the cosmic dawn using the SKA
- Cosmic Shear Covariance Matrix in CDM: Cosmology Matters
- Statistics of extreme objects in the Juropa Hubble Volume simulation
- Cosmological neutrino simulations at extreme scale
- Euclid Preparation. XXVIII. Forecasts for ten different higher-order weak lensing statistics
- On the insufficiency of arbitrarily precise covariance matrices: non-Gaussian weak lensing likelihoods
- 21-cm signal from cosmic dawn - II: Imprints of the light-cone effects
- The Large-Scale Observational Signatures of Low-Mass Galaxies During Reionization
- Precision reconstruction of the dark matter-neutrino relative velocity from N-body simulations
- Prediction of the 21-cm signal from reionization: comparison between 3D and 1D radiative transfer schemes
- 2HOT: An Improved Parallel Hashed Oct-Tree N-Body Algorithm for Cosmological Simulation
- Position-dependent power spectra of the 21-cm signal from the epoch of reionization
- Recovering the HII region size statistics from 21-cm tomography
- FlowPM: Distributed TensorFlow Implementation of the FastPM Cosmological N-body Solver
- How to estimate the 3D power spectrum of the Lyman- forest
- Simulating the Impact of X-ray Heating during the Cosmic Dawn
- Measuring the topology of reionization with Betti numbers
- 2dFLenS and KiDS: Determining source redshift distributions with cross-correlations
- The skewed weak lensing likelihood: why biases arise, despite data and theory being sound
- FORGE -- the f(R) gravity cosmic emulator project I: Introduction and matter power spectrum emulator
- Euclid. V. The Flagship galaxy mock catalogue: a comprehensive simulation for the Euclid mission
- Evaluating the QSO contribution to the 21-cm signal from the Cosmic Dawn
- Nonlinear reconstruction
- The Jubilee ISW Project I: simulated ISW and weak lensing maps and initial power spectra results
- Studying reionization with the next generation of Ly-alpha emitter surveys
- CFHTLenS and RCSLenS Cross-Correlation with Planck Lensing Detected in Fourier and Configuration Space
- Neutral island statistics during reionization from 21-cm tomography
- Differential Neutrino Condensation onto Cosmic Structure
- Nonlinear Bias of Cosmological Halo Formation in the Early Universe
- A direct measurement of tomographic lensing power spectra from CFHTLenS
- The impact of inhomogeneous subgrid clumping on cosmic reionization
- Probing dark energy with tomographic weak-lensing aperture mass statistics
- Deep learning approach for identification of HII regions during reionization in 21-cm observations
- The wedge bias in reionization 21-cm power spectrum measurements
- Redshift-space distortions in simulations of the 21-cm signal from the cosmic dawn
- CosmoGridV1: a simulated CDM theory prediction for map-level cosmological inference
- Redshifted 21-cm bispectrum II: Impact of the spin temperature fluctuations and redshift space distortions on the signal from the Cosmic Dawn
- On the road to percent accuracy III: non-linear reaction of the matter power spectrum to massive neutrinos
- Measurement of the Cold Dark Matter-Neutrino Dipole in the TianNu Simulation
- Cosmic tidal reconstruction
- Effects of the sources of reionization on 21-cm redshift-space distortions
- Persistent homology in cosmic shear II: A tomographic analysis of DES-Y1
- Halo nonlinear reconstruction
- Halo Formation from Yukawa Forces in the Very Early Universe
- Recovering lost 21 cm radial modes via cosmic tidal reconstruction
- Predictions for measuring the 21-cm multi-frequency angular power spectrum using SKA-Low
- KiDS-1000 Cosmology: Constraints from density split statistics
- KiDS-450: Enhancing cosmic shear with clipping transformations
- The Effects of Lyman-Limit Systems on the Evolution and Observability of the Epoch of Reionization
- Nonlinear reconstruction of redshift space distortions
- CUBE: An Information-optimized parallel Cosmological -body Algorithm
- The impact of inhomogeneous subgrid clumping on cosmic reionization II: modelling stochasticity
- The Impact of Nonlinear Structure Formation on the Power Spectrum of Transverse Momentum Fluctuations and the Kinetic Sunyaev-Zel'dovich Effect
- Neutrino effects on the morphology of cosmic large-scale structure
- Deep learning approach for identification of HII regions during reionization in 21-cm observations -- II. foreground contamination
- Cosmic neutrinos: dispersive and non-linear
- Enhancing cosmic shear with the multi-scale lensing PDF
- On cosmological bias due to the magnification of shear and position samples in modern weak lensing analyses
- The large-scale 21-cm power spectrum from reionization
- The Cross-correlation of KSZ Effect and 21 cm Intensity Mapping with Tidal Reconstruction
- Increasing Fisher Information by Moving-Mesh Reconstruction
- Cosmological implications of the composite spectra of galactic X-ray binaries constructed using MAXI data
- Covariance of the redshift-space matter power spectrum after reconstruction
- Dark Matter Distribution Induced by a Cosmic String Wake in the Nonlinear Regime
- Constraints on the state of the IGM at using redshifted 21-cm observations with LOFAR
- The cosmological simulation code
- Reducing the Impact of Weak-lensing Errors on Gravitational-wave Standard Sirens
- Biased tracer reconstruction with halo mass information
- Bayesian approach to constraining the properties of ionized bubbles during reionization
- A revised density split statistic model for general filters
- pyCRay: A flexible and GPU-accelerated Radiative Transfer Framework for Simulating the Cosmic Epoch of Reionization
- Redshifted 21-cm bispectrum: Impact of the source models on the signal and the IGM physics from the Cosmic Dawn
- Sensitivity tests of cosmic velocity fields to massive neutrinos
- Modelling the stochasticity of high-redshift halo bias
- Nonlinear -mode clustering in Lagrangian space
- PINION: Physics-informed neural network for accelerating radiative transfer simulations for cosmic reionization
- Bayesian Control Variates for optimal covariance estimation with pairs of simulations and surrogates
- Distinguishing reionization models using the largest cluster statistics of the 21-cm maps
- Horizon Run 3: Topology as a Standard Ruler
- Nonlinear Reconstruction of the Velocity Field
- CUBE -- Towards an Optimal Scaling of Cosmological N-body Simulations
- Impact of the Epoch of Reionization sources on the 21-cm bispectrum
- Studying the Multi-frequency Angular Power Spectrum of the Cosmic Dawn 21-cm Signal
- Measuring the reionization 21 cm fluctuations using clustering wedges
- Starlet higher order statistics for galaxy clustering and weak lensing
- Enabling Radiative Transfer on AMR grids in CRASH
- DESI Mock Challenge: Constructing DESI galaxy catalogues based on FastPM simulations
- Large HI optical depth and Redshifted 21-cm signal from cosmic dawn
- Joint inference of multiplicative and additive systematics in galaxy density fluctuations and clustering measurements
- Signature of a Cosmic String Wake at
- Enhanced Small-Scale Structure in the Cosmic Dark Ages
- Field-Level Comparison and Robustness Analysis of Cosmological N-body Simulations
- Cosmic String Wake Detection using 3D Ridgelet Transformations
- New simulation of QSO X-ray heating during the Cosmic Dawn
- Cosmological neutrino N-body simulations of dark matter halo
- The Effect of Large Optical Depths on the Non-Gaussian 21-cm signal from Cosmic Dawn
- Impact of anisotropic photon emission from sources during the epoch of reionisation
- Generative modeling of convergence maps based on predicted one-point statistics
- Effect of Neutrinos on Angular Momentum of Dark Matter Halo
- Reionization in HESTIA: Studying reionization in the LG through zoom simulations