DISPATCH: A Numerical Simulation Framework for the Exa-scale Era. I. Fundamentals
arXiv:1705.10774 · doi:10.1093/mnras/sty599
Abstract
We introduce a high-performance simulation framework that permits the semi-independent, task-based solution of sets of partial differential equations, typically manifesting as updates to a collection of `patches' in space-time. A hybrid MPI/OpenMP execution model is adopted, where work tasks are controlled by a rank-local `dispatcher' which selects, from a set of tasks generally much larger than the number of physical cores (or hardware threads), tasks that are ready for updating. The definition of a task can vary, for example, with some solving the equations of ideal magnetohydrodynamics (MHD), others non-ideal MHD, radiative transfer, or particle motion, and yet others applying particle-in-cell (PIC) methods. Tasks do not have to be grid-based, while tasks that are, may use either Cartesian or orthogonal curvilinear meshes. Patches may be stationary or moving. Mesh refinement can be static or dynamic. A feature of decisive importance for the overall performance of the framework is that time steps are determined and applied locally; this allows potentially large reductions in the total number of updates required in cases when the signal speed varies greatly across the computational domain, and therefore a corresponding reduction in computing time. Another feature is a load balancing algorithm that operates `locally' and aims to simultaneously minimise load and communication imbalance. The framework generally relies on already existing solvers, whose performance is augmented when run under the framework, due to more efficient cache usage, vectorisation, local time-stepping, plus near-linear and, in principle, unlimited OpenMP and MPI scaling.
arXiv comment17 pages, 8 figures. Accepted by MNRAS
References in corpus (46)
- The cosmological simulation code GADGET-2
- E pur si muove: Galiliean-invariant cosmological hydrodynamical simulations on a moving mesh
- Cosmological Hydrodynamics with Adaptive Mesh Refinement: a new high resolution code called RAMSES
- PLUTO: a Numerical Code for Computational Astrophysics
- Astrophysics Source Code Library
- GIZMO: A New Class of Accurate, Mesh-Free Hydrodynamic Simulation Methods
- Athena: A New Code for Astrophysical MHD
- Enzo: An Adaptive Mesh Refinement Code for Astrophysics
- Adaptive Refinement Tree - a new high-resolution N-body code for cosmological simulations
- The stellar atmosphere simulation code Bifrost
- A High Order Godunov Scheme with Constrained Transport and Adaptive Mesh Refinement for Astrophysical MHD
- A comparative study of disc-planet interaction
- CASTRO: A New Compressible Astrophysical Solver. I. Hydrodynamics and Self-Gravity
- FARGO3D: A new GPU-oriented MHD code
- MPI-AMRVAC for Solar and Astrophysics
- Hydromagnetic turbulence in computer simulations
- HYPERION: An open-source parallelized three-dimensional dust continuum radiative transfer code
- Supernova Driving. I. The Origin of Molecular Cloud Turbulence
- On the diffusive propagation of warps in thin accretion discs
- A Survey of High Level Frameworks in Block-Structured Adaptive Mesh Refinement Packages
- Radiative transfer with scattering for domain-decomposed 3D MHD simulations of cool stellar atmospheres
- Comparing Numerical Methods for Isothermal Magnetized Supersonic Turbulence
- TESS: A Relativistic Hydrodynamics Code on a Moving Voronoi Mesh
- A Godunov Method for Multidimensional Radiation Magnetohydrodynamics based on a variable Eddington tensor
- Zoom-Simulations of Protoplanetary Disks starting from GMC scales
- Simulating Magnetohydrodynamical Flow with Constrained Transport and Adaptive Mesh Refinement; Algorithms & Tests of the AstroBEAR Code
- Beyond Flux-Limited Diffusion: Parallel Algorithms for Multidimensional Radiation Hydrodynamics
- On the Formation of Active Regions
- Crash: A Block-Adaptive-Mesh Code for Radiative Shock Hydrodynamics - Implementation and Verification
- Hybrid Characteristics: 3D radiative transfer for parallel adaptive mesh refinement hydrodynamics
- Three-Dimensional Radiation-Hydrodynamics Calculations of the Envelopes of Young Planets Embedded in Protoplanetary Disks
- Supernova Driving. IV. The Star Formation Rate of Molecular Clouds
- Incorporating Ambipolar and Ohmic Diffusion in the AMR MHD code RAMSES
- GANDALF - Graphical Astrophysics code for N-body Dynamics And Lagrangian Fluids
- Pebble dynamics and accretion onto rocky planets. I. Adiabatic and convective models
- Ambipolar Drift Heating in Turbulent Molecular Clouds
- Radiative transfer in decomposed domains
- Tracking the distribution of Al and Fe during the early phases of star and disk evolution
- Simulating hydromagnetic processes in star formation: introducing ambipolar diffusion into an adaptive mesh refinement code
- Kinetic modeling of particle acceleration in a solar null point reconnection region
- Photon-Plasma: a modern high-order particle-in-cell code
- A Fast, Accurate and Robust Algorithm For Transferring Radiation in Three-Dimensional Space
- WOMBAT: A Scalable and High Performance Astrophysical MHD Code
- Radiation hydrodynamics including irradiation and adaptive mesh refinement with AZEuS. I. Methods
- PATCHWORK: A Multipatch Infrastructure for Multiphysics/Multiscale/Multiframe Fluid Simulations
- AZEuS: An Adaptive Zone Eulerian Scheme for Computational MHD
Cited by in corpus (24)
- The Athena++ Adaptive Mesh Refinement Framework: Design and Magnetohydrodynamic Solvers
- MPI-AMRVAC 3.0: updates to an open-source simulation framework
- Episodic accretion: the interplay of infall and disc instabilities
- The Role of Magnetic Fields in Protostellar Outflows and Star Formation
- The Bridge: a transient phenomenon of forming stellar multiples
- SILCC-ZOOM: The early impact of ionizing radiation on forming molecular clouds
- Pebble dynamics and accretion onto rocky planets. I. Adiabatic and convective models
- The Origin of the Stellar Mass Distribution and Multiplicity
- The Probability Distribution of Density Fluctuations in Supersonic Turbulence
- Self-consistent 3D radiative MHD simulations of coronal rain formation and evolution
- Pebble dynamics and accretion onto rocky planets. II. Radiative models
- Constraints on the (re-)orientation of star-disk systems through infall
- Detailed Balance and Exact Results for Density Fluctuations in Supersonic Turbulence
- CosTuuM: polarized thermal dust emission by magnetically oriented spheroidal grains
- CMacIonize 2.0: a novel task-based approach to Monte Carlo radiation transfer
- Runko: Modern multiphysics toolbox for plasma simulations
- Inaccuracy of Spatial Derivatives in Simulations of Supersonic Turbulence
- Energy Efficiency trends in HPC: what high-energy and astrophysicists need to know
- WENO-Wombat: Scalable Fifth-Order Constrained-Transport Magnetohydrodynamics for Astrophysical Applications
- The time step constraint in radiation hydrodynamics
- Toward Realistic Solar Flare Models: An explicit Particle-In-Cell solver in the DISPATCH framework
- Modeling of Chromospheric Features and Dynamics in Solar Plage
- M3DIS -- A grid of 3D radiation-hydrodynamics stellar atmosphere models for stellar surveys. II. Carbon-enhanced metal-poor stars
- DISPATCH methods: an approximate, entropy-based Riemann solver for ideal magnetohydrodynamics