24.77 Pflops on a Gravitational Tree-Code to Simulate the Milky Way Galaxy with 18600 GPUs

Abstract

We have simulated, for the first time, the long term evolution of the Milky Way Galaxy using 51 billion particles on the Swiss Piz Daint supercomputer with our $N$-body gravitational tree-code Bonsai. Herein, we describe the scientific motivation and numerical algorithms. The Milky Way model was simulated for 6 billion years, during which the bar structure and spiral arms were fully formed. This improves upon previous simulations by using 1000 times more particles, and provides a wealth of new data that can be directly compared with observations. We also report the scalability on both the Swiss Piz Daint and the US ORNL Titan. On Piz Daint the parallel efficiency of Bonsai was above 95%. The highest performance was achieved with a 242 billion particle Milky Way model using 18600 GPUs on Titan, thereby reaching a sustained GPU and application performance of 33.49 Pflops and 24.77 Pflops respectively.

12 pages, 4 figures, Published in: 'Proceeding SC '14 Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis'. Gordon Bell Prize 2014 finalist

References in corpus (7)

• High Performance Direct Gravitational N-body Simulations on Graphics Processing Units -- II: An implementation in CUDA
• A multiphysics and multiscale software environment for modeling astrophysical systems
• Transient spirals as superposed instabilities
• High Performance Direct Gravitational N-body Simulations on Graphics Processing Unit I: An implementation in Cg
• Mapping a stellar disk into a boxy bulge: The outside-in part of the Milky Way bulge formation
• Astrophysical Particle Simulations on Heterogeneous CPU-GPU Systems
• Visualizing Astrophysical N-body Systems

Cited by in corpus (18)

• Trimodal structure of Hercules stream explained by originating from bar resonances
• Capture of exocomets and the erosion of the Oort cloud due to stellar encounters in the Galaxy
• The rate of stellar encounters along a migrating orbit of the Sun
• GOTHIC: Gravitational oct-tree code accelerated by hierarchical time step controlling
• Radial phase spirals in the Solar neighbourhood
• Ripples spreading across the Galactic disc. Interplay of direct and indirect effects of the Sagittarius dwarf impact
• On $N$-body simulations of globular cluster stream
• Weighing the Galactic disk using phase-space spirals IV. Tests on a three-dimensional galaxy simulation
• Impact of bar resonances in the velocity-space distribution of the solar neighbourhood stars in a self-consistent $N$-body Galactic disc simulation
• Simulating a stellar contact binary merger -- I. Stellar models
• Cornerstone: Octree Construction Algorithms for Scalable Particle Simulations
• Delayed phase mixing in the self-gravitating Galactic disc
• Resolving local and global kinematic signatures of satellite mergers with billion particle simulations
• Communication Reducing Algorithms for Distributed Hierarchical N-Body Problems with Boundary Distributions
• The First Star-by-star $N$-body/Hydrodynamics Simulation of Our Galaxy Coupling with a Surrogate Model
• The dark matter wake of a galactic bar revealed by multichannel Singular Spectral Analysis
• GPU-Enabled Particle-Particle Particle-Tree Scheme for Simulating Dense Stellar Cluster System
• Multiscale Computing in the Exascale Era