Waging a Campaign: Results from an Injection-Recovery Study involving 35 numerical Relativity Simulations and three Waveform Models

Abstract

We present Bayesian inference results from an extensive injection-recovery campaign to test the validity of three state of the art quasicircular gravitational waveform models: \textsc{SEOBNRv5PHM}, \textsc{IMRPhenomTPHM}, \textsc{IMRPhenomXPHM}, the latter with the \textsc{SpinTaylorT4} implementation for its precession dynamics. We analyze 35 strongly precessing binary black hole numerical relativity simulations with all available harmonic content. Ten simulations have a mass ratio of $4:1$ and five, mass ratio of $8:1$. Overall, we find that \textsc{SEOBNRv5PHM} is the most consistent model to numerical relativity, with the majority of true source properties lying within the inferred 90\% credible interval. However, we find that none of the models can reliably infer the true source properties for binaries with mass ratio $8:1$ systems. We additionally conduct inspiral-merger-ringdown (IMR) consistency tests to determine if our chosen state of the art waveform models infer consistent properties when analysing only the inspiral (low frequency) and ringdown (high frequency) portions of the signal. For the simulations considered in this work, we find that the IMR consistency test depends on the frequency that separates the inspiral and ringdown regimes. For two sensible choices of the cutoff frequency, we report that \textsc{IMRPhenomXPHM} can produce false GR deviations. Meanwhile, we find that \textsc{IMRPhenomTPHM} is the most reliable model under the IMR consistency test. Finally, we re-analyze the same 35 simulations, but this time we incorporate model accuracy into our Bayesian inference. Consistent with the work in Hoy et al. 2024 [arXiv: 2409.19404], we find this approach generally yields more accurate inferred properties for binary black holes with less biases compared to methods that combine model-dependent posterior distributions based on their evidence, or with equal weight.

arXiv comment30 pages, 12 figures, matches the published version modulo minor differences

References in corpus (119)

• Observation of Gravitational Waves from a Binary Black Hole Merger
• Planck 2015 results. XIII. Cosmological parameters
• Advanced Virgo: a 2nd generation interferometric gravitational wave detector
• GWTC-1: A Gravitational-Wave Transient Catalog of Compact Binary Mergers Observed by LIGO and Virgo during the First and Second Observing Runs
• Advanced LIGO
• GWTC-2: Compact Binary Coalescences Observed by LIGO and Virgo During the First Half of the Third Observing Run
• Quasinormal modes of black holes and black branes
• dynesty: A Dynamic Nested Sampling Package for Estimating Bayesian Posteriors and Evidences
• Quasi-Normal Modes of Stars and Black Holes
• GWTC-3: Compact Binary Coalescences Observed by LIGO and Virgo During the Second Part of the Third Observing Run
• Tests of general relativity with GW150914
• Bilby: A user-friendly Bayesian inference library for gravitational-wave astronomy
• Frequency-domain gravitational waves from non-precessing black-hole binaries. II. A phenomenological model for the advanced detector era
• Properties of the Binary Black Hole Merger GW150914
• Robust parameter estimation for compact binaries with ground-based gravitational-wave observations using the LALInference software library
• Tests of General Relativity with the Binary Black Hole Signals from the LIGO-Virgo Catalog GWTC-1
• Tests of General Relativity with Binary Black Holes from the second LIGO-Virgo Gravitational-Wave Transient Catalog
• Frequency-domain gravitational waves from non-precessing black-hole binaries. I. New numerical waveforms and anatomy of the signal
• A simple model of complete precessing black-hole-binary gravitational waveforms
• Detection, Measurement and Gravitational Radiation
• Coalescence of Two Spinning Black Holes: An Effective One-Body Approach
• An improved effective-one-body model of spinning, nonprecessing binary black holes for the era of gravitational-wave astrophysics with advanced detectors
• Computationally efficient models for the dominant and sub-dominant harmonic modes of precessing binary black holes
• Search templates for gravitational waves from inspiraling binaries: Choice of template spacing
• Gravitational waves from inspiralling compact binaries: Parameter estimation using second-post-Newtonian waveforms
• Bayesian inference for compact binary coalescences with BILBY: Validation and application to the first LIGO--Virgo gravitational-wave transient catalogue
• Maximum gravitational recoil
• The SXS Collaboration catalog of binary black hole simulations
• A catalog of 174 binary black-hole simulations for gravitational-wave astronomy
• Surrogate models for precessing binary black hole simulations with unequal masses
• Towards models of gravitational waveforms from generic binaries II: Modelling precession effects with a single effective precession parameter
• Supermassive recoil velocities for binary black-hole mergers with antialigned spins
• Higher-order spin effects in the amplitude and phase of gravitational waveforms emitted by inspiraling compact binaries: Ready-to-use gravitational waveforms
• Illuminating Black Hole Binary Formation Channels with Spins in Advanced LIGO
• IMRPhenomXHM: A multi-mode frequency-domain model for the gravitational wave signal from non-precessing black-hole binaries
• Analysis of spin precession in binary black hole systems including quadrupole-monopole interaction
• Time-domain effective-one-body gravitational waveforms for coalescing compact binaries with nonprecessing spins, tides and self-spin effects
• Setting the cornerstone for the IMRPhenomX family of models for gravitational waves from compact binaries: The dominant harmonic for non-precessing quasi-circular black holes
• PyCBC Inference: A Python-based parameter estimation toolkit for compact binary coalescence signals
• Surrogate model of hybridized numerical relativity binary black hole waveforms
• Enriching the Symphony of Gravitational Waves from Binary Black Holes by Tuning Higher Harmonics
• Real-time gravitational-wave science with neural posterior estimation
• Modeling the dynamics of tidally-interacting binary neutron stars up to merger
• 4-OGC: Catalog of gravitational waves from compact-binary mergers
• The final spin from binary black holes in quasi-circular orbits
• Validating the effective-one-body model of spinning, precessing binary black holes against numerical relativity
• Towards models of gravitational waveforms from generic binaries: A simple approximate mapping between precessing and non-precessing inspiral signals
• Spin orientations of merging black holes formed from the evolution of stellar binaries
• Spin-Orbit Misalignment in Close Binaries with Two Compact Objects
• Bayesian parameter estimation using conditional variational autoencoders for gravitational-wave astronomy
• Compact Binary Coalescences in the Band of Ground-based Gravitational-Wave Detectors
• Hierarchical data-driven approach to fitting numerical relativity data for nonprecessing binary black holes with an application to final spin and radiated energy
• Georgia Tech Catalog of Gravitational Waveforms
• Observation of Gravitational Waves from the Coalescence of a $2.5\text{-}4.5M_{\odot }$ Compact Object and a Neutron Star
• Constructing Gravitational Waves from Generic Spin-Precessing Compact Binary Inspirals
• Degeneracy between mass and spin in black-hole-binary waveforms
• The final mass and spin of black hole mergers
• New binary black hole mergers in the LIGO--Virgo O3a data
• Tracking the precession of compact binaries from their gravitational-wave signal
• A faithful analytical effective one body waveform model for spin-aligned, moderately eccentric, coalescing black hole binaries
• Gravitational-wave parameter estimation with autoregressive neural network flows
• SEOBNRv5PHM: Next generation of accurate and efficient multipolar precessing-spin effective-one-body waveforms for binary black holes
• Laying the foundation of the effective-one-body waveform models SEOBNRv5: improved accuracy and efficiency for spinning non-precessing binary black holes
• Testing general relativity using golden black-hole binaries
• A multipolar effective one body waveform model for spin-aligned black hole binaries
• Effective one body multipolar waveform model for spin-aligned, quasi-circular, eccentric, hyperbolic black hole binaries
• Error-analysis and comparison to analytical models of numerical waveforms produced by the NRAR Collaboration
• Analytic modelling of tidal effects in the relativistic inspiral of binary neutron stars
• Effects of waveform model systematics on the interpretation of GW150914
• Learning Bayesian posteriors with neural networks for gravitational-wave inference
• Testing general relativity using gravitational wave signals from the inspiral, merger and ringdown of binary black holes
• A novel scheme for rapid parallel parameter estimation of gravitational waves from compact binary coalescences
• Binary black hole mergers: large kicks for generic spin orientations
• A geometric approach to the precession of compact binaries
• The Formation and Gravitational-Wave Detection of Massive Stellar Black-Hole Binaries
• The NINJA-2 catalog of hybrid post-Newtonian/numerical-relativity waveforms for non-precessing black-hole binaries
• New twists in compact binary waveform modelling: a fast time domain model for precession
• The RIT binary black hole simulations catalog
• General-relativistic precession in a black-hole binary
• PESummary: the code agnostic Parameter Estimation Summary page builder
• Remnant of binary black-hole mergers: New simulations and peak luminosity studies
• Effective-one-body waveforms for precessing coalescing compact binaries with post-newtonian Twist
• Effective-one-body multipolar waveform for tidally interacting binary neutron stars up to merger
• The final twist: A model of gravitational waves from precessing black-hole binaries through merger and ringdown
• Measuring gravitational-wave higher-order modes
• A new analytic representation of the ringdown waveform of coalescing spinning black hole binaries
• The second RIT binary black hole simulations catalog and its application to gravitational waves parameter estimation
• PhenomXO4a: a phenomenological gravitational-wave model for precessing black-hole binaries with higher multipoles and asymmetries
• The Third RIT binary black hole simulations catalog
• A hybrid post-Newtonian -- effective-one-body scheme for spin-precessing compact-binary waveforms
• Two-harmonic approximation for gravitational waveforms from precessing binaries
• Possible Causes of False General Relativity Violations in Gravitational Wave Observations
• Waveform uncertainty quantification and interpretation for gravitational-wave astronomy
• Comparing Post-Newtonian and Numerical-Relativity Precession Dynamics
• Testing General Relativity with Gravitational Waves: An Overview
• Testing the validity of the single-spin approximation in inspiral-merger-ringdown waveforms
• Physics of eccentric binary black hole mergers: A numerical relativity perspective
• Towards a gravitational self force-informed effective-one-body waveform model for nonprecessing, eccentric, large-mass-ratio inspirals
• Systematic bias on the inspiral-merger-ringdown consistency test due to neglect of orbital eccentricity
• New binary black hole mergers in the LIGO-Virgo O3b data
• Impact of Numerical Relativity information on effective-one-body waveform models
• Multi-waveform inference of gravitational waves
• Revisiting the evidence for precession in GW200129 with machine learning noise mitigation
• Ringdown frequencies in black holes formed from precessing black-hole binaries
• Systematic Biases in Estimating the Properties of Black Holes Due to Inaccurate Gravitational-Wave Models
• VARAHA: A Fast Non-Markovian sampler for estimating Gravitational-Wave posteriors
• Numerical-Relativity-Informed Effective-One-Body model for Black-Hole-Neutron-Star Mergers with Higher Modes and Spin Precession
• Accelerating Multi-Model Bayesian Inference, Model Selection and Systematic Studies for Gravitational Wave Astronomy
• Accurate and Efficient Waveform Model for Precessing Binary Black Holes
• The Issues of Mismodelling Gravitational-Wave Data for Parameter Estimation
• Inspiral-Merger-Ringdown Consistency Tests with Higher Modes on Gravitational Signals from the Second Observing Run of LIGO and Virgo
• Incorporation of model accuracy in gravitational wave Bayesian inference
• Probabilistic Model for the Gravitational Wave Signal from Merging Black Holes
• Application of the third RIT binary black hole simulations catalog to parameter estimation of gravitational waves signals from the LIGO-Virgo O1/O2 observational runs
• Rarity of precession and higher-order multipoles in gravitational waves from merging binary black holes
• Impact of anti-symmetric contributions to signal multipoles in the measurement of black-hole spins
• Prospects for measuring off-axis spins of binary black holes with Plus-era gravitational-wave detectors
• Binary Black Hole Waveforms from High-Resolution GR-Athena++ Simulations
• Revisiting the relationship of black-hole kicks and multipole asymmetries

Cited by in corpus (3)

• The impact of precession and higher-order multipoles for gravitational wave cosmological inference
• Reconsidering the consistent use of precessing, higher order multipole models for gravitational wave analyses
• The Missing Multipole Problem: Investigating biases from model starting frequency in gravitational-wave analyses