AsterX: a new open-source GPU-accelerated GRMHD code for dynamical spacetimes
arXiv:2406.11669 · doi:10.1088/1361-6382/ad9c11
Abstract
We present AsterX, a novel open-source, modular, GPU-accelerated, fully general relativistic magnetohydrodynamic (GRMHD) code designed for dynamic spacetimes in 3D Cartesian coordinates, and tailored for exascale computing. We utilize block-structured adaptive mesh refinement (AMR) through CarpetX, the new driver for the Einstein Toolkit, which is built on AMReX, a software framework for massively parallel applications. AsterX employs the Valencia formulation for GRMHD, coupled with the Z4c formalism for spacetime evolution, while incorporating high resolution shock capturing schemes to accurately handle the hydrodynamics. AsterX has undergone rigorous testing in both static and dynamic spacetime, demonstrating remarkable accuracy and agreement with other codes in literature. Using subcycling in time, we find an overall performance gain of factor 2.5 to 4.5. Benchmarking the code through scaling tests on OLCF's Frontier supercomputer, we demonstrate a weak scaling efficiency of about 67%-77% on 4096 nodes compared to an 8-node performance.
42 pages, 13 figures
References in corpus (72)
- GW170817: Observation of Gravitational Waves from a Binary Neutron Star Inspiral
- Multi-messenger Observations of a Binary Neutron Star Merger
- Gravitational Waves and Gamma-rays from a Binary Neutron Star Merger: GW170817 and GRB 170817A
- GW170817: Measurements of Neutron Star Radii and Equation of State
- GW190425: Observation of a Compact Binary Coalescence with Total Mass
- Origin of the heavy elements in binary neutron-star mergers from a gravitational wave event
- Spectroscopic identification of r-process nucleosynthesis in a double neutron star merger
- Athena: A New Code for Astrophysical MHD
- Constraining the Maximum Mass of Neutron Stars From Multi-Messenger Observations of GW170817
- Observation of gravitational waves from two neutron star-black hole coalescences
- Optical emission from a kilonova following a gravitational-wave-detected neutron-star merger
- Superluminal motion of a relativistic jet in the neutron star merger GW170817
- An Unsplit Godunov Method for Ideal MHD via Constrained Transport
- Compact radio emission indicates a structured jet was produced by a binary neutron star merger
- Smoothed Particle Hydrodynamics in Astrophysics
- The NANOGrav 15-year Data Set: Constraints on Supermassive Black Hole Binaries from the Gravitational Wave Background
- Late time afterglow observations reveal a collimated relativistic jet in the ejecta of the binary neutron star merger GW170817
- ECHO: an Eulerian Conservative High Order scheme for general relativistic magnetohydrodynamics and magnetodynamics
- Primitive Variable Solvers for Conservative General Relativistic Magnetohydrodynamics
- Constraint violation in free evolution schemes: comparing BSSNOK with a conformal decomposition of Z4
- Long-term GRMHD Simulations of Neutron Star Merger Accretion Disks: Implications for Electromagnetic Counterparts
- Binary neutron star mergers: a jet engine for short gamma-ray bursts
- Effects of the microphysical Equation of State in the mergers of magnetized Neutron Stars With Neutrino Cooling
- Three-dimensional GRMHD simulations of neutrino-cooled accretion disks from neutron star mergers
- Accurate evolutions of inspiralling and magnetized neutron-stars: equal-mass binaries
- Compact binary evolutions with the Z4c formulation
- Observation of Gravitational Waves from the Coalescence of a Compact Object and a Neutron Star
- Circumbinary MHD Accretion into Inspiraling Binary Black Holes
- WhiskyMHD: a new numerical code for general relativistic magnetohydrodynamics
- High-Order Fully General-Relativistic Hydrodynamics: new Approaches and Tests
- Twisted-torus configurations with large toroidal magnetic fields in relativistic stars
- GRHydro: A new open source general-relativistic magnetohydrodynamics code for the Einstein Toolkit
- IllinoisGRMHD: An Open-Source, User-Friendly GRMHD Code for Dynamical Spacetimes
- Binary Black-Hole Mergers in Magnetized Disks: Simulations in Full General Relativity
- AMReX: Block-Structured Adaptive Mesh Refinement for Multiphysics Applications
- First 100 ms of a long-lived magnetized neutron star formed in a binary neutron star merger
- The Exact Solution of the Riemann Problem in Relativistic MHD
- A magnetar engine for short GRBs and kilonovae
- Relativistic magnetohydrodynamics in dynamical spacetimes: A new AMR implementation
- Electromagnetic Counterparts to Massive Black Hole Mergers
- A Second Order Godunov Method for Multidimensional Relativistic Magnetohydrodynamics
- Disc Tearing and Bardeen-Petterson Alignment in GRMHD Simulations of Highly Tilted Thin Accretion Discs
- Relativistic MHD in dynamical spacetimes: Improved EM gauge condition for AMR grids
- Quasi-Periodic Behavior of Mini-Disks in Binary Black Holes Approaching Merger
- Tight multi-messenger constraints on the neutron star equation of state from GW170817 and a forward model for kilonova light curve synthesis
- Collimated outflows from long-lived binary neutron star merger remnants
- Relativistic Dynamics and Mass Exchange in Binary Black Hole Mini-Disks
- General relativistic simulations of pasive-magneto-rotational core collapse with microphysics
- Quasi-Periodicity of Supermassive Binary Black Hole Accretion Approaching Merger
- Electromagnetic Signatures from Supermassive Binary Black Holes Approaching Merger
- GRMHD simulations of neutron-star mergers with weak interactions: r-process nucleosynthesis and electromagnetic signatures of dynamical ejecta
- Robust Recovery of Primitive Variables in Relativistic Ideal Magnetohydrodynamics
- Jet Launching from Binary Neutron Star Mergers: Incorporating Neutrino Transport and Magnetic Fields
- Parthenon -- a performance portable block-structured adaptive mesh refinement framework
- Circumbinary Disk Accretion into Spinning Black Hole Binaries
- Systematic construction of upwind constrained transport schemes for MHD
- Implementation of advanced Riemann solvers in a neutrino-radiation magnetohydrodynamics code in numerical relativity and its application to a binary neutron star merger
- Large Eddy Simulations of Magnetized Mergers of Neutron Stars with Neutrinos
- Spritz: a new fully general-relativistic magnetohydrodynamic code
- Impact of a mean field dynamo on neutron star mergers leading to magnetar remnants
- -process Nucleosynthesis and Kilonovae from Hypermassive Neutron Star Remnants
- HARM3D+NUC: A new method for simulating the post-merger phase of binary neutron star mergers with GRMHD, tabulated EOS and neutrino leakage
- GRaM-X: A new GPU-accelerated dynamical spacetime GRMHD code for Exascale computing with the Einstein Toolkit
- An Operator-Based Local Discontinuous Galerkin Method Compatible With the BSSN Formulation of the Einstein Equations
- Addition of tabulated equation of state and neutrino leakage support to IllinoisGRMHD
- Simflowny 3: An upgraded platform for scientific modelling and simulation
- Toward a Consistent Framework for High Order Mesh Refinement Schemes in Numerical Relativity
- The Guided Moments formalism: a new efficient full-neutrino treatment for astrophysical simulations
- Spritz: General Relativistic Magnetohydrodynamics with Neutrinos
- Large Eddy Simulations of Magnetized Mergers of Black Holes and Neutron Stars
- Implementing a new recovery scheme for primitive variables in the general relativistic magnetohydrodynamic code Spritz
- Magnetic equilibria of relativistic axisymmetric stars: The impact of flow constants
Cited by in corpus (4)
- Performance-Portable Binary Neutron Star Mergers with AthenaK
- Neutron star evolution by combining discontinuous Galerkin and finite volume methods
- Machine learning-driven conservative-to-primitive conversion in hybrid piecewise polytropic and tabulated equations of state
- A Black Hole is Born: 3D GRMHD Simulation of Black Hole Formation from Core-Collapse