GRAthena++: puncture evolutions on vertex-centered oct-tree AMR

Abstract

Numerical relativity is central to the investigation of astrophysical sources in the dynamical and strong-field gravity regime, such as binary black hole and neutron star coalescences. Current challenges set by gravitational-wave and multi-messenger astronomy call for highly performant and scalable codes on modern massively-parallel architectures. We present GR-Athena++, a general-relativistic, high-order, vertex-centered solver that extends the oct-tree, adaptive mesh refinement capabilities of the astrophysical (radiation) magnetohydrodynamics code Athena++. To simulate dynamical space-times GR-Athena++ uses the Z4c evolution scheme of numerical relativity coupled to the moving puncture gauge. We demonstrate stable and accurate binary black hole merger evolutions via extensive convergence testing, cross-code validation, and verification against state-of-the-art effective-one-body waveforms. GR-Athena++ leverages the task-based parallelism paradigm of Athena++ to achieve excellent scalability. We measure strong scaling efficiencies above $95\%$ for up to $\sim 1.2\times 10^4$ CPUs and excellent weak scaling is shown up to $\sim 10^5$ CPUs in a production binary black hole setup with adaptive mesh refinement. GR-Athena++ thus allows for the robust simulation of compact binary coalescences and offers a viable path towards numerical relativity at exascale.

References in corpus (24)

• GW170817: Observation of Gravitational Waves from a Binary Neutron Star Inspiral
• Exploring the Sensitivity of Next Generation Gravitational Wave Detectors
• Athena: A New Code for Astrophysical MHD
• The Athena++ Adaptive Mesh Refinement Framework: Design and Magnetohydrodynamic Solvers
• Calibration of Moving Puncture Simulations
• The Dynamics of Binary Neutron Star Mergers and of GW170817
• Binary black-hole evolutions of excision and puncture data
• Accurate Effective-One-Body waveforms of inspiralling and coalescing black-hole binaries
• Consistency of post-Newtonian waveforms with numerical relativity
• Reducing phase error in long numerical binary black hole evolutions with sixth order finite differencing
• Neutron Star Merger Remnants
• Intermediate-mass-ratio black hole binaries: intertwining numerical and perturbative techniques
• The second RIT binary black hole simulations catalog and its application to gravitational waves parameter estimation
• Simulations of black-hole binaries with unequal masses or non-precessing spins: accuracy, physical properties, and comparison with post-Newtonian results
• Implementation of standard testbeds for numerical relativity
• Simulations of rotating neutron star collapse with the puncture gauge: end state and gravitational waveforms
• Implementation of higher-order absorbing boundary conditions for the Einstein equations
• Gravitational-Wave Extraction from Neutron Star Oscillations: comparing linear and nonlinear techniques
• Numerical evolution of multiple black holes with accurate initial data
• Testing the Accuracy and Stability of Spectral Methods in Numerical Relativity
• A Reinvestigation of Moving Punctured Black Holes with a New Code
• An efficient iterative method to reduce eccentricity in numerical-relativity simulations of compact binary inspiral
• Numerical relativity in spherical coordinates: A new dynamical spacetime and general relativistic MHD evolution framework for the Einstein Toolkit
• Action principle for Numerical Relativity evolution systems

Cited by in corpus (21)

• The Science of the Einstein Telescope
• GRChombo: An adaptable numerical relativity code for fundamental physics
• Lessons for adaptive mesh refinement in numerical relativity
• An Extension of the Athena++ Code Framework for Radiation-Magnetohydrodynamics in General Relativity Using a Finite-Solid-Angle Discretization
• The Athena++ Adaptive Mesh Refinement Framework: Multigrid Solvers for Self-Gravity
• Scattering and dynamical capture of two black holes: synergies between numerical and analytical methods
• The new discontinuous Galerkin methods based numerical relativity program Nmesh
• A scalable elliptic solver with task-based parallelism for the SpECTRE numerical relativity code
• Adaptive hp-Refinement for Spectral Elements in Numerical Relativity
• Performance-Portable Binary Neutron Star Mergers with AthenaK
• Boson star head-on collisions with constraint-violating and constraint-satisfying initial data
• Adaptive mesh refinement in binary black holes simulations
• Binary Black Hole Waveforms from High-Resolution GR-Athena++ Simulations
• Investigating the Impact of Higher-Order Phase Transitions in Binary Neutron-Star Mergers
• Exploring the Dynamics of General Relativistic Binary-Single and Binary-Binary Encounters of Black Holes
• Discontinuous Galerkin scheme for elliptic equations on extremely stretched grids
• ExaGRyPE: Numerical General Relativity Solvers Based upon the Hyperbolic PDEs Solver Engine ExaHyPE
• Neutron star evolution by combining discontinuous Galerkin and finite volume methods
• A User-Friendly Python Interface for the Numerical Relativity Code AMSS-NCKU
• AthenaK simulations of the binary black hole merger GW150914
• superB/NRPy: Scalable, Task-Based Numerical Relativity for 3G Gravitational Wave Science