SpECTRE: A Task-based Discontinuous Galerkin Code for Relativistic Astrophysics
arXiv:1609.00098 · doi:10.1016/j.jcp.2016.12.059
Abstract
We introduce a new relativistic astrophysics code, SpECTRE, that combines a discontinuous Galerkin method with a task-based parallelism model. SpECTRE's goal is to achieve more accurate solutions for challenging relativistic astrophysics problems such as core-collapse supernovae and binary neutron star mergers. The robustness of the discontinuous Galerkin method allows for the use of high-resolution shock capturing methods in regions where (relativistic) shocks are found, while exploiting high-order accuracy in smooth regions. A task-based parallelism model allows efficient use of the largest supercomputers for problems with a heterogeneous workload over disparate spatial and temporal scales. We argue that the locality and algorithmic structure of discontinuous Galerkin methods will exhibit good scalability within a task-based parallelism framework. We demonstrate the code on a wide variety of challenging benchmark problems in (non)-relativistic (magneto)-hydrodynamics. We demonstrate the code's scalability including its strong scaling on the NCSA Blue Waters supercomputer up to the machine's full capacity of 22,380 nodes using 671,400 threads.
arXiv comment41 pages, 13 figures, and 7 tables. Ancillary data contains simulation input files
References in corpus (44)
- Gamma-Ray Bursts as the Death Throes of Massive Binary Stars
- Explosion Mechanisms of Core-Collapse Supernovae
- Enzo: An Adaptive Mesh Refinement Code for Astrophysics
- HARM: A Numerical Scheme for General Relativistic Magnetohydrodynamics
- The Einstein Toolkit: A Community Computational Infrastructure for Relativistic Astrophysics
- The PLUTO Code for Adaptive Mesh Computations in Astrophysical Fluid Dynamics
- Perspectives on Core-Collapse Supernova Theory
- Numerical Relativity Using a Generalized Harmonic Decomposition
- A New Generalized Harmonic Evolution System
- ECHO: an Eulerian Conservative High Order scheme for general relativistic magnetohydrodynamics and magnetodynamics
- Constraint damping in the Z4 formulation and harmonic gauge
- CASTRO: A New Compressible Astrophysical Solver. I. Hydrodynamics and Self-Gravity
- High Order Upwind Schemes for Multidimensional Magnetohydrodynamics
- Beyond ideal MHD: towards a more realistic modeling of relativistic astrophysical plasmas
- A Survey of High Level Frameworks in Block-Structured Adaptive Mesh Refinement Packages
- RAM: A Relativistic Adaptive Mesh Refinement Hydrodynamics Code
- GRHydro: A new open source general-relativistic magnetohydrodynamics code for the Einstein Toolkit
- Implementation of a simplified approach to radiative transfer in general relativity
- Numerical Magnetohydrodynamics in Astrophysics: Algorithm and Tests for Multi-Dimensional Flow
- A Second Order Godunov Method for Multidimensional Relativistic Magnetohydrodynamics
- Solving the relativistic magnetohydrodynamics equations with ADER discontinuous Galerkin methods, a posteriori subcell limiting and adaptive mesh refinement
- Discontinuous Galerkin methods for general-relativistic hydrodynamics: formulation and application to spherically symmetric spacetimes
- Assessment of a high-resolution central scheme for the solution of the relativistic hydrodynamics equations
- An Improved Exact Riemann Solver for Relativistic Hydrodynamics
- Astrophysical hydrodynamics with a high-order discontinuous Galerkin scheme and adaptive mesh refinement
- Simulations of inspiraling and merging double neutron stars using the Spectral Einstein Code
- A discontinuous Galerkin method for solving the fluid and MHD equations in astrophysical simulations
- SWIFT: Using task-based parallelism, fully asynchronous communication, and graph partition-based domain decomposition for strong scaling on more than 100,000 cores
- Discontinuous Galerkin method for computing gravitational waveforms from extreme mass ratio binaries
- Solving 3D relativistic hydrodynamical problems with WENO discontinuous Galerkin methods
- A Subluminal Relativistic Magnetohydrodynamics Scheme with ADER-WENO Predictor and Multidimensional Riemann Solver-Based Corrector
- Finite Element, Discontinuous Galerkin, and Finite Difference Evolution Schemes in Spacetime
- Formulation of discontinuous Galerkin methods for relativistic astrophysics
- Numerical simulations with a first order BSSN formulation of Einstein's field equations
- Discontinuous Galerkin method for the spherically reduced BSSN system with second-order operators
- Magnetic effects on the low-T/|W| instability in differentially rotating neutron stars
- General Relativistic Magnetohydrodynamic Bondi--Hoyle Accretion
- Short note on the mass matrix for Gauss-Lobatto grid points
- Exact solution of the 1D Riemann problem in Newtonian and relativistic hydrodynamics
- Bound-Preserving Discontinuous Galerkin Methods for Conservative Phase Space Advection in Curvilinear Coordinates
- General Relativistic Hydrodynamics with a Roe solver
- A Simple and Effective High-Order Shock-Capturing Limiter for Discontinuous Galerkin Methods
- Massive Computation for Understanding Core-Collapse Supernova Explosions
- An ADER-WENO Finite Volume AMR code for Astrophysics
Cited by in corpus (72)
- Deep Neural Networks to Enable Real-time Multimessenger Astrophysics
- The Pencil Code, a modular MPI code for partial differential equations and particles: multipurpose and multiuser-maintained
- A waveform model for eccentric binary black hole based on effective-one-body-numerical-relativity (EOBNR) formalism
- Beyond second-order convergence in simulations of magnetised binary neutron stars with realistic microphysics
- The Science of the Einstein Telescope
- GRChombo: An adaptable numerical relativity code for fundamental physics
- Quasinormal-mode filters: a new approach to analyze the gravitational-wave ringdown of binary black-hole mergers
- Improved Cauchy-characteristic evolution system for high-precision numerical relativity waveforms
- SENR/NRPy+: Numerical Relativity in Singular Curvilinear Coordinate Systems
- ADER discontinuous Galerkin schemes for general-relativistic ideal magnetohydrodynamics
- Massively Parallel Simulations of Binary Black Hole Intermediate-Mass-Ratio Inspirals
- Conformal and covariant Z4 formulation of the Einstein equations: strongly hyperbolic first-order reduction and solution with discontinuous Galerkin schemes
- GRAthena++: puncture evolutions on vertex-centered oct-tree AMR
- Lessons for adaptive mesh refinement in numerical relativity
- Jet: Fast quantum circuit simulations with parallel task-based tensor-network contraction
- Using Deep Learning to Localize Gravitational Wave Sources
- High-order Magnetohydrodynamics for Astrophysics with an Adaptive Mesh Refinement Discontinuous Galerkin Scheme
- Numerical relativity in spherical coordinates: A new dynamical spacetime and general relativistic MHD evolution framework for the Einstein Toolkit
- Compact binary coalescences: Constraints on waveforms
- Scalar self-force for highly eccentric equatorial orbits in Kerr spacetime
- Entropy Stable Discontinuous Galerkin Methods for Balance Laws in Non-Conservative Form: Applications to the Euler Equations with Gravity
- Statistical and systematic uncertainties in extracting the source properties of neutron star - black hole binaries with gravitational waves
- General-relativistic neutron star evolutions with the discontinuous Galerkin method
- Gravitational-wave echoes from numerical-relativity waveforms via space-time construction near merging compact objects
- GRaM-X: A new GPU-accelerated dynamical spacetime GRMHD code for Exascale computing with the Einstein Toolkit
- Detecting resonant tidal excitations of Rossby modes in coalescing neutron-star binaries with third-generation gravitational-wave detectors
- The new discontinuous Galerkin methods based numerical relativity program Nmesh
- Fully relativistic three-dimensional Cauchy-characteristic matching for physical degrees of freedom
- Addition of tabulated equation of state and neutrino leakage support to IllinoisGRMHD
- A comparison of momentum transport models for numerical relativity
- Entropy-limited hydrodynamics: a novel approach to relativistic hydrodynamics
- Smooth equations of state for high-accuracy simulations of neutron star binaries
- A Physical-Constraint-Preserving Finite Volume WENO Method for Special Relativistic Hydrodynamics on Unstructured Meshes
- CosmosDG: An hp-Adaptive Discontinuous Galerkin Code for Hyper-Resolved Relativistic MHD
- Adaptive hp-Refinement for Spectral Elements in Numerical Relativity
- A scalable elliptic solver with task-based parallelism for the SpECTRE numerical relativity code
- Simulating magnetized neutron stars with discontinuous Galerkin methods
- Performance-Portable Binary Neutron Star Mergers with AthenaK
- Boson star head-on collisions with constraint-violating and constraint-satisfying initial data
- General Relativistic Hydrodynamics on a Moving-mesh I: Static Spacetimes
- Adaptive mesh refinement in binary black holes simulations
- Python Open Source Waveform Extractor (POWER): An open source, Python package to monitor and post-process numerical relativity simulations
- A high-order shock capturing discontinuous Galerkin-finite-difference hybrid method for GRMHD
- Survey of gravitational wave memory in intermediate mass ratio binaries
- thornado-hydro: a discontinuous Galerkin method for supernova hydrodynamics with nuclear equations of state
- Supporting High-Performance and High-Throughput Computing for Experimental Science
- Unified discontinuous Galerkin scheme for a large class of elliptic equations
- A hp-adaptive discontinuous Galerkin solver for elliptic equations in numerical relativity
- High-order Discontinuous Galerkin hydrodynamics with sub-cell shock capturing on GPUs
- Binary Black Hole Waveforms from High-Resolution GR-Athena++ Simulations
- Echoes from beyond: Detecting gravitational-wave quantum imprints with LISA
- Spectral Difference method with a posteriori limiting: Application to the Euler equations in one and two space dimensions
- Simulating neutron stars with a flexible enthalpy-based equation of state parametrization in SpECTRE
- The Bondi problem revisited: a spectral domain decomposition code
- Quasistationary hair for binary black hole initial data in scalar Gauss-Bonnet gravity
- Axisymmetric Hydrodynamics in Numerical Relativity Using a Multipatch Method
- A Discontinuous Galerkin Solver in the FLASH Multi-Physics Framework
- High-accuracy numerical models of Brownian thermal noise in thin mirror coatings
- Multidomain Galerkin-Collocation method: spherical collapse of scalar fields II
- Future Simulations of Tidal Disruption Events
- ROXAS: a new pseudospectral non-linear code for general relativistic oscillations of fast rotating isolated neutron stars
- High-order discontinuous Galerkin schemes with subcell finite volume limiter and adaptive mesh refinement for a monolithic first-order BSSNOK formulation of the Einstein-Euler equations
- Signatures of Quantum Gravity in Gravitational Wave Memory
- Toward exponentially-convergent simulations of extreme-mass-ratio inspirals: A time-domain solver for the scalar Teukolsky equation with singular source terms
- Eccentricity as a signature of hierarchical subsolar-mass mergers in collapsar disks
- Numerical simulations of oscillating and differentially rotating neutron stars
- Extremely High-Order Convergence in Simulations of Relativistic Stars
- BHaHAHA: A Fast, Robust Apparent Horizon Finder Library for Numerical Relativity
- Neutron star evolution by combining discontinuous Galerkin and finite volume methods
- PatchworkWave: A Multipatch Infrastructure for Multiphysics/Multiscale/Multiframe/Multimethod Simulations at Arbitrary Order
- AthenaK simulations of the binary black hole merger GW150914
- A User-Friendly Python Interface for the Numerical Relativity Code AMSS-NCKU