GRAPE-6: The massively-parallel special-purpose computer for astrophysical particle simulation

Abstract

In this paper, we describe the architecture and performance of the GRAPE-6 system, a massively-parallel special-purpose computer for astrophysical $N$-body simulations. GRAPE-6 is the successor of GRAPE-4, which was completed in 1995 and achieved the theoretical peak speed of 1.08 Tflops. As was the case with GRAPE-4, the primary application of GRAPE-6 is simulation of collisional systems, though it can be used for collisionless systems. The main differences between GRAPE-4 and GRAPE-6 are (a) The processor chip of GRAPE-6 integrates 6 force-calculation pipelines, compared to one pipeline of GRAPE-4 (which needed 3 clock cycles to calculate one interaction), (b) the clock speed is increased from 32 to 90 MHz, and (c) the total number of processor chips is increased from 1728 to 2048. These improvements resulted in the peak speed of 64 Tflops. We also discuss the design of the successor of GRAPE-6.

Accepted for publication in PASJ, scheduled to appear in Vol. 55, No. 6

Cited by in corpus (114)

• The cosmological simulation code GADGET-2
• The formation of massive black holes through collision runaway in dense young star clusters
• Formation and Dynamical Evolution of Multiple Stellar Generations in Globular Clusters
• A comprehensive set of simulations studying the influence of gas expulsion on star cluster evolution
• Massive Black Hole Binary Evolution
• The properties of Galactic globular cluster sub-systems
• Star cluster disruption by giant molecular clouds
• The DRAGON simulations: globular cluster evolution with a million stars
• Accelerating NBODY6 with Graphics Processing Units
• A Complete N-body Model of the Old Open Cluster M67
• Stellar remnants in galactic nuclei: mass segregation
• NBODY6++GPU: Ready for the gravitational million-body problem
• A multiphysics and multiscale software environment for modeling astrophysical systems
• Black holes and core expansion in massive star clusters
• A dynamical origin for early mass segregation in young star clusters
• Massive Black Holes in Star Clusters. II. Realistic Cluster Models
• Disruption time scales of star clusters in different galaxies
• Performance Analysis of Direct N-Body Algorithms on Special-Purpose Supercomputers
• Lifetimes of tidally limited star clusters with different radii
• Dynamical Evolution and Spatial Mixing of Multiple Population Globular Clusters
• PeTar: a high-performance N-body code for modeling massive collisional stellar systems
• The ecology of star clusters and intermediate mass black holes in the Galactic bulge
• N-body simulations of gravitational dynamics
• Implementation and performance of FDPS: A Framework Developing Parallel Particle Simulation Codes
• Structure in phase space associated with spiral and bar density waves in an N-body galactic disk
• BRIDGE: A Direct-tree Hybrid N-body Algorithm for Fully Self-consistent Simulations of Star Clusters and their Parent Galaxies
• SAPPORO: A way to turn your graphics cards into a GRAPE-6
• Massive Black Holes in Star Clusters. I. Equal-mass clusters
• 6th and 8th Order Hermite Integrator for N-body Simulations
• GreeM : Massively Parallel TreePM Code for Large Cosmological N-body Simulations
• Mass loss rates and the mass evolution of star clusters
• Evolution of Massive Black Hole Binaries
• Direct N-Body Modeling of the Old Open Cluster NGC 188: A Detailed Comparison of Theoretical and Observed Binary Star and Blue Straggler Populations
• GRAPE-6A: A single-card GRAPE-6 for parallel PC-GRAPE cluster system
• The effect of spiral arm passages on the evolution of stellar clusters
• Dynamics of galaxy cores and supermassive black holes
• Runaway collisions in young star clusters. I. Methods and tests
• The effect of stellar-mass black holes on the structural evolution of massive star clusters
• SEREN - A new SPH code for star and planet formation simulations
• Evolution of Galactic Nuclei. I. orbital evolution of IMBH
• Effects of Primordial Mass Segregation on the Dynamical Evolution of Star Clusters
• VINE -- A numerical code for simulating astrophysical systems using particles I: Description of the physics and the numerical methods
• Tracing intermediate-mass black holes in the Galactic Centre
• High mass-to-light ratios of UCDs - Evidence for dark matter ?
• Star Clusters in Evolving Galaxies
• Evolution of Massive Blackhole Triples I -- Equal-mass binary-single systems
• Comparative study between N-body and Fokker-Planck simulations for rotating star clusters: I. Equal-mass system
• Phantom-GRAPE: numerical software library to accelerate collisionless $N$-body simulation with SIMD instruction set on x86 architecture
• The influence of gas expulsion and initial mass-segregation on the stellar mass-function of globular star clusters
• Tidal Capture of Stars by Intermediate-Mass Black Holes
• Performance Tuning of N-Body Codes on Modern Microprocessors: I. Direct Integration with a Hermite Scheme on x86_64 Architecture
• FAST: A Fully Asynchronous Split Time-Integrator for Self-Gravitating Fluid
• N-body simulation for self-gravitating collisional systems with a new SIMD instruction set extension to the x86 architecture, Advanced Vector eXtensions
• The Size Scale of Star Clusters
• Graphic-Card Cluster for Astrophysics (GraCCA) -- Performance Tests
• Investigating the retention of intermediate-mass black holes in star clusters using N-body simulations
• Formation of Omega Centauri by Tidal Stripping of a Dwarf Galaxy
• PPPM and TreePM Methods on GRAPE Systems for Cosmological N-body Simulations
• VINE -- A numerical code for simulating astrophysical systems using particles II: Implementation and performance characteristics
• A Hybrid N-Body Code Incorporating Algorithmic Regularization and Post-Newtonian Forces
• On the onset of runaway stellar collisions in dense star clusters I. Dynamics of the first collision
• N-Body Simulations on GPUs
• $N$-body Simulation of Planetesimal Formation Through Gravitational Instability of a Dust Layer
• Trojan Stars in the Galactic Center
• Star Cluster Ecology: VII The evolution of young dense star clusters containing primordial binaries
• The Chamomile Scheme: An Optimized Algorithm for N-body simulations on Programmable Graphics Processing Units
• Formation of Protoplanets from Massive Planetesimals in Binary Systems
• The evolution of binary star clusters and the nature of NGC2136/NGC2137
• Accelerated FDPS --- Algorithms to Use Accelerators with FDPS
• Evolution of Star Clusters near the Galactic Center: Fully Self-consistent N-body Simulations
• Antonov problem and quasi-equilibrium states in N-body system
• GOTHIC: Gravitational oct-tree code accelerated by hierarchical time step controlling
• A Particle Simulation for the Pulsar Magnetosphere: Relationship of Polar Cap, Slot Gap, and Outer Gap
• Performance analysis of direct N-body algorithms for astrophysical simulations on distributed systems
• The radial alignment of dark matter subhalos: from simulations to observations
• Unexpected Formation Modes of the First Hard Binary in Core Collapse
• A review of High Performance Computing foundations for scientists
• SIRIUS project II: a new tree-direct hybrid code for smoothed particle hydrodynamics/N-body simulations of star clusters
• QYMSYM: A GPU-Accelerated Hybrid Symplectic Integrator That Permits Close Encounters
• Effects of Hardness of Primordial Binaries on Evolution of Star Clusters
• Vectorization and Parallelization of the Adaptive Mesh Refinement N-body Code
• PENTACLE: Parallelized Particle-Particle Particle-Tree Code for Planet Formation
• The Adaptive TreePM: An Adaptive Resolution Code for Cosmological N-body Simulations
• MYRIAD: A new N-body code for simulations of Star Clusters
• Star Cluster Evolution in Dark Matter Dominated Galaxies
• A Monte Carlo study of early gas expulsion and evolution of star clusters: new simulations with the MOCCA code in the AMUSE framework
• Star cluster evolution in barred disc galaxies. I. Planar periodic orbits
• The initial conditions of observed star clusters - I. Method description and validation
• A Natural Symmetrization for the Plummer Potential
• Finite element modelling of perturbed stellar systems
• Jeans Instability in a Tidally Disrupted Halo Satellite Galaxy
• N-Body Simulation of Planetesimal Formation through Gravitational Instability and Coagulation. II. Accretion Model
• Particle-particle Particle-tree Code for Planetary System Formation with Individual Cut-off Method: GPLUM
• Sowing the seeds of massive black holes in small galaxies: Young clusters as the building blocks of Ultra-Compact-Dwarf Galaxies
• A Modified TreePM Code
• PHoToNs--A Parallel Heterogeneous & Threads oriented code for cosmological N-body simulation
• Performance analysis of parallel gravitational $N$-body codes on large GPU cluster
• Distributed N-body Simulation on the Grid Using Dedicated Hardware
• Missing Dwarf Problem in Galaxy Clusters
• Visualizing Astrophysical N-body Systems
• Modeling Merging Galaxies using MINGA - Improving Restricted N-body by Dynamical Friction
• Modeling Dense Stellar Systems
• Merger Criteria of Multiple Massive Black Holes and the Impact on the Host Galaxy
• The Effect of Pre-Main Sequence Stars on Star Cluster Dynamics
• Modified Hermite Integrators of Arbitrary Order
• Gurzadyan's Problem 5 and improvement of softenings for cosmological simulations using the PP method
• Effects of Minor Mergers on Coalescence of a Supermassive Black Hole Binary
• AstroGrid-D: Grid Technology for Astronomical Science
• How well do STARLAB and NBODY4 compare? I: Simple models
• How well do STARLAB and NBODY compare? II: Hardware and accuracy
• Hierarchical Tree Algorithm for Collisional N-body Simulations on GRAPE
• Acceleration of the tree method with SIMD instruction set
• The self gravity effect on the orbital stability of Twotinos
• Ejection of Hyper-Velocity Stars from the Galactic Centre by Intermediate-Mass Black Holes