Massively Parallel Simulations of Binary Black Hole Intermediate-Mass-Ratio Inspirals
arXiv:1807.06128 · doi:10.1137/18M1196972
Abstract
We present a highly-scalable framework that targets problems of interest to the numerical relativity and broader astrophysics communities. This framework combines a parallel octree-refined adaptive mesh with a wavelet adaptive multiresolution and a physics module to solve the Einstein equations of general relativity in the BSSN formulation. The goal of this work is to perform advanced, massively parallel numerical simulations of Intermediate Mass Ratio Inspirals (IMRIs) of binary black holes with mass ratios on the order of 100:1. These studies will be used to generate waveforms as used in LIGO data analysis and to calibrate semi-analytical approximate methods. Our framework consists of a distributed memory octree-based adaptive meshing framework in conjunction with a node-local code generator. The code generator makes our code portable across different architectures. The equations corresponding to the target application are written in symbolic notation and generators for different architectures can be added independent of the application. Additionally, this symbolic interface also makes our code extensible, and as such has been designed to easily accommodate many existing algorithms in astrophysics for plasma dynamics and radiation hydrodynamics. Our adaptive meshing algorithms and data-structures have been optimized for modern architectures with deep memory hierarchies. This enables our framework to have achieve excellent performance and scalability on modern leadership architectures. We demonstrate excellent weak scalability up to 131K cores on ORNL's Titan for binary mergers for mass ratios up to 100.
References in corpus (52)
- Observation of Gravitational Waves from a Binary Black Hole Merger
- GW170817: Observation of Gravitational Waves from a Binary Neutron Star Inspiral
- Advanced Virgo: a 2nd generation interferometric gravitational wave detector
- Multi-messenger Observations of a Binary Neutron Star Merger
- Gravitational Waves and Gamma-rays from a Binary Neutron Star Merger: GW170817 and GRB 170817A
- GW151226: Observation of Gravitational Waves from a 22-Solar-Mass Binary Black Hole Coalescence
- GW170104: Observation of a 50-Solar-Mass Binary Black Hole Coalescence at Redshift 0.2
- GW170814: A Three-Detector Observation of Gravitational Waves from a Binary Black Hole Coalescence
- An Ordinary Short Gamma-Ray Burst with Extraordinary Implications: Fermi-GBM Detection of GRB 170817A
- Accurate Evolutions of Orbiting Black-Hole Binaries Without Excision
- Predictions for the Rates of Compact Binary Coalescences Observable by Ground-based Gravitational-wave Detectors
- INTEGRAL Detection of the First Prompt Gamma-Ray Signal Coincident with the Gravitational Wave Event GW170817
- Astrophysical Implications of the Binary Black-Hole Merger GW150914
- New constraints on radii and tidal deformabilities of neutron stars from GW170817
- Modeling GW170817 based on numerical relativity and its implications
- Calibration of Moving Puncture Simulations
- Validating the effective-one-body model of spinning, precessing binary black holes against numerical relativity
- 3+1 Formalism and Bases of Numerical Relativity
- Estimating the Contribution of Dynamical Ejecta in the Kilonova Associated with GW170817
- The Origin of r-Process Elements in the Milky Way
- High resolution numerical-relativity simulations for the merger of binary magnetized neutron stars
- Simulating coalescing compact binaries by a new code SACRA
- Georgia Tech Catalog of Gravitational Waveforms
- Accurate black hole evolutions by fourth-order numerical relativity
- Search for High-energy Neutrinos from Binary Neutron Star Merger GW170817 with ANTARES, IceCube, and the Pierre Auger Observatory
- Simulations of Binary Black Hole Mergers Using Spectral Methods
- Numerical relativity simulations of binary neutron stars
- General Relativistic Three-Dimensional Multi-Group Neutrino Radiation-Hydrodynamics Simulations of Core-Collapse Supernovae
- IllinoisGRMHD: An Open-Source, User-Friendly GRMHD Code for Dynamical Spacetimes
- Numerical Relativity and Astrophysics
- Transformations of asymptotic gravitational-wave data
- Kranc: a Mathematica application to generate numerical codes for tensorial evolution equations
- The RIT binary black hole simulations catalog
- Orbital Evolution of Extreme-Mass-Ratio Black-Hole Binaries with Numerical Relativity
- SpECTRE: A Task-based Discontinuous Galerkin Code for Relativistic Astrophysics
- Magnetized Neutron Stars With Realistic Equations of State and Neutrino Cooling
- The Missing Link: Bayesian Detection and Measurement of Intermediate-Mass Black-Hole Binaries
- Observing IMBH-IMBH Binary Coalescences via Gravitational Radiation
- Hyperbolicity of the BSSN system of Einstein evolution equations
- The numerical relativity breakthrough for binary black holes
- Extreme black hole simulations: collisions of unequal mass black holes and the point particle limit
- Three dimensional evolution of differentially rotating magnetized neutron stars
- The Singularity Threshold of the Nonlinear Sigma Model Using 3D Adaptive Mesh Refinement
- Intermediate Mass Ratio Black Hole Binaries: Numerical Relativity meets Perturbation Theory
- The Peano software - parallel, automaton-based, dynamically adaptive grid traversals
- Solving 3D relativistic hydrodynamical problems with WENO discontinuous Galerkin methods
- The most powerful astrophysical events: Gravitational-wave peak luminosity of binary black holes as predicted by numerical relativity
- Formulation of discontinuous Galerkin methods for relativistic astrophysics
- A Simple method to set up low eccentricity initial data for moving puncture simulations
- Numerical relativity in spherical coordinates with the Einstein Toolkit
- Studies of waveform requirements for intermediate mass-ratio coalescence searches with advanced detectors
- Computational Relativistic Astrophysics With Adaptive Mesh Refinement: Testbeds
Cited by in corpus (23)
- The Gravitational-Wave Physics II: Progress
- The Science of the Einstein Telescope
- Adiabatic waveforms from extreme-mass-ratio inspirals: an analytical approach
- GRAthena++: puncture evolutions on vertex-centered oct-tree AMR
- Lessons for adaptive mesh refinement in numerical relativity
- Industrial scale large eddy simulations (LES) with adaptive octree meshes using immersogeometric analysis
- A fully-coupled framework for solving Cahn-Hilliard Navier-Stokes equations: Second-order, energy-stable numerical methods on adaptive octree based meshes
- A projection-based, semi-implicit time-stepping approach for the Cahn-Hilliard Navier-Stokes equations on adaptive octree meshes
- The new discontinuous Galerkin methods based numerical relativity program Nmesh
- Nonlinear Evolution of Quadratic Gravity in 3+1 Dimensions
- Nonlinear Dynamics of Quadratic Gravity in Spherical Symmetry
- Scalable adaptive PDE solvers in arbitrary domains
- A scalable elliptic solver with task-based parallelism for the SpECTRE numerical relativity code
- Performance-Portable Binary Neutron Star Mergers with AthenaK
- A spectral method algorithm for numerical simulations of gravitational fields
- Discontinuous Galerkin scheme for elliptic equations on extremely stretched grids
- HPC-driven computational reproducibility in numerical relativity codes: A use case study with IllinoisGRMHD
- ExaGRyPE: Numerical General Relativity Solvers Based upon the Hyperbolic PDEs Solver Engine ExaHyPE
- Nyquist-resolving gravitational waves via orbital frequency-based refinement
- Extremely High-Order Convergence in Simulations of Relativistic Stars
- Neutron star evolution by combining discontinuous Galerkin and finite volume methods
- Redshift factor and the small mass-ratio limit in binary black hole simulations
- superB/NRPy: Scalable, Task-Based Numerical Relativity for 3G Gravitational Wave Science