GreeM : Massively Parallel TreePM Code for Large Cosmological N-body Simulations

Abstract

In this paper, we describe the implementation and performance of GreeM, a massively parallel TreePM code for large-scale cosmological N-body simulations. GreeM uses a recursive multi-section algorithm for domain decomposition. The size of the domains are adjusted so that the total calculation time of the force becomes the same for all processes. The loss of performance due to non-optimal load balancing is around 4%, even for more than 10^3 CPU cores. GreeM runs efficiently on PC clusters and massively-parallel computers such as a Cray XT4. The measured calculation speed on Cray XT4 is 5 \times 10^4 particles per second per CPU core, for the case of an opening angle of θ=0.5, if the number of particles per CPU core is larger than 10^6.

13 pages, 11 figures, accepted by PASJ

References in corpus (2)

• Variation of the subhalo abundance in dark matter halos
• A Modified TreePM Code

Cited by in corpus (73)

• The Uchuu Simulations: Data Release 1 and Dark Matter Halo Concentrations
• Large-scale dark matter simulations
• Implementation and performance of FDPS: A Framework Developing Parallel Particle Simulation Codes
• Hierarchical Formation of Dark Matter Halos and the Free Streaming Scale
• Diversity of dark matter density profiles in the Galactic dwarf spheroidal satellites
• Gamma-ray Signal from Earth-mass Dark Matter Microhalos
• The Cosmogrid Simulation: Statistical Properties of Small Dark Matter Halos
• Modeling evolution of dark matter substructure and annihilation boost
• Where are the Low-Mass Population III Stars ?
• SILVERRUSH. VI. A simulation of Ly$\alpha$ emitters in the reionization epoch and a comparison with Subaru Hyper Suprime-Cam survey early data
• 24.77 Pflops on a Gravitational Tree-Code to Simulate the Milky Way Galaxy with 18600 GPUs
• Particle-Particle Particle-Tree: A Direct-Tree Hybrid Scheme for Collisional N-Body Simulations
• Phantom-GRAPE: numerical software library to accelerate collisionless $N$-body simulation with SIMD instruction set on x86 architecture
• CARPool: fast, accurate computation of large-scale structure statistics by pairing costly and cheap cosmological simulations
• How Biased Are Halo Properties in Cosmological Simulations?
• Evolution of star clusters in a cosmological tidal field
• The Abundance and Structure of Subhaloes near the Free Streaming Scale and Their Impact on Indirect Dark Matter Searches
• Dynamical Evolution of Primordial Dark Matter Haloes through Mergers
• The New Numerical Galaxy Catalog (${\nu }^2$GC): An Updated Semi-analytic Model of Galaxy and AGN with Large Cosmological N-body Simulation
• Constraints on warm dark matter from weak lensing in anomalous quadruple lenses
• Anti-hierarchical evolution of the Active Galactic Nucleus space density in a hierarchical universe
• Precise Cosmological Constraints from BOSS Galaxy Clustering with a Simulation-Based Emulator of the Wavelet Scattering Transform
• Imprint of anisotropic primordial non-Gaussianity on halo intrinsic alignments in simulations
• Accelerated FDPS --- Algorithms to Use Accelerators with FDPS
• A Parameter-Masked Mock Data Challenge for Beyond-Two-Point Galaxy Clustering Statistics
• Detectability of 21cm-signal during the Epoch of Reionization with 21cm-Lyman-$\alpha$ emitter cross-correlation. I
• GOTHIC: Gravitational oct-tree code accelerated by hierarchical time step controlling
• The Uchuu-UniverseMachine dataset: Galaxies in and around Clusters
• Constraining Self-Interacting Dark Matter with Dwarf Spheroidal Galaxies and High-resolution Cosmological $N$-body Simulations
• Simulating the universe on an intercontinental grid of supercomputers
• A Hybrid Fast Multipole Method for Cosmological N-body Simulations
• PENTACLE: Parallelized Particle-Particle Particle-Tree Code for Planet Formation
• Mass and size growth of early-type galaxies by dry mergers in cluster environments
• Virial halo mass function in the $Planck$ cosmology
• A Light-Weight Communication Library for Distributed Computing
• Constraints on small-scale cosmological fluctuations from SNe lensing dispersion
• Detectability of 21cm-signal during the Epoch of Reionization with 21cm-Lyman-α emitter cross-correlation. II. Foreground contamination
• Impacts of new small-scale N-body simulations on dark matter annihilations constrained from cosmological 21cm line observations
• High Performance Gravitational N-body Simulations on a Planet-wide Distributed Supercomputer
• Constraining Cosmological Parameters using the Cluster Mass-Richness Relation
• Bayesian Control Variates for optimal covariance estimation with pairs of simulations and surrogates
• Effect of interstellar objects on metallicity of low-mass first stars formed in a cosmological model
• The Uchuu-GLAM BOSS and eBOSS LRG lightcones: Exploring clustering and covariance errors
• The Ultramarine Simulation: properties of dark matter haloes before redshift 5.5
• The DESI One-Percent Survey: Modelling the clustering and halo occupation of all four DESI tracers with Uchuu
• PHoToNs--A Parallel Heterogeneous & Threads oriented code for cosmological N-body simulation
• Predicting 21cm-line map from Lyman $\alpha$ emitter distribution with Generative Adversarial Networks
• Inferring dark matter halo properties for HI-selected galaxies
• A semi-analytic model of pairwise velocity distribution between dark matter halos
• Discrimination of heavy elements originating from Pop III stars in z = 3 intergalactic medium
• Astrophysical Particle Simulations on Heterogeneous CPU-GPU Systems
• Cosmic evolution of grain size distribution in galaxies using the ${\nu }^2$GC semi-analytic model
• Optical galaxy cluster mock catalogs with realistic projection effects: Validations with the SDSS clusters
• PhotoNs-GPU:A GPU accelerated cosmological simulation code
• A Machine Learning Approach to Correct for Mass Resolution Effects in Simulated Halo Clustering Statistics
• Constraining cosmological parameters using void statistics from the SDSS survey
• Subhalo abundance matching using progenitor mass at varying redshift: Two modes of stellar mass growth imprinted into the Subaru HSC galaxy clustering
• Massively Parallel Computation of Accurate Densities for N-body Dark Matter Simulations using the Phase-Space-Element Method
• Cosmological boost factor for dark matter annihilation at redshifts of $z=10$-$100$ using the power spectrum approach
• The Correlation Function and Detection of Baryon Acoustic Oscillation Peak from the Spectroscopic SDSS GalWCat Galaxy Cluster Catalogue
• PySCo: A fast Particle-Mesh $N$-body code for modified gravity simulations in Python
• The impact of baryons on the sparsity of simulated galaxy clusters from The Three Hundred Project
• Acceleration of the tree method with SIMD instruction set
• GPU accelerated Hybrid Tree Algorithm for Collision-less N-body Simulations
• Impact of projection-induced optical selection bias on the weak lensing mass calibration of galaxy clusters
• Constraining Galaxy-Halo Connection Using Machine Learning
• MPWide: a light-weight library for efficient message passing over wide area networks
• Dynamical Properties and Velocity Dispersion-Mass Relation of $z\sim 1$ Galaxy Clusters from the GOGREEN and GCLASS Surveys
• Testing subhalo abundance matching with galaxy kinematics
• From Thread to Transcontinental Computer: Disturbing Lessons in Distributed Supercomputing
• Comparison of simulations and semi-analytical model for WDM subhalo mass functions
• Timing the last major merger of galaxy clusters with large halo sparsity
• The cosmic web in CosmoGrid void regions