MLGWSC-1: The first Machine Learning Gravitational-Wave Search Mock Data Challenge
arXiv:2209.11146 · doi:10.1103/PhysRevD.107.023021
Abstract
We present the results of the first Machine Learning Gravitational-Wave Search Mock Data Challenge (MLGWSC-1). For this challenge, participating groups had to identify gravitational-wave signals from binary black hole mergers of increasing complexity and duration embedded in progressively more realistic noise. The final of the 4 provided datasets contained real noise from the O3a observing run and signals up to a duration of 20 seconds with the inclusion of precession effects and higher order modes. We present the average sensitivity distance and runtime for the 6 entered algorithms derived from 1 month of test data unknown to the participants prior to submission. Of these, 4 are machine learning algorithms. We find that the best machine learning based algorithms are able to achieve up to 95% of the sensitive distance of matched-filtering based production analyses for simulated Gaussian noise at a false-alarm rate (FAR) of one per month. In contrast, for real noise, the leading machine learning search achieved 70%. For higher FARs the differences in sensitive distance shrink to the point where select machine learning submissions outperform traditional search algorithms at FARs per month on some datasets. Our results show that current machine learning search algorithms may already be sensitive enough in limited parameter regions to be useful for some production settings. To improve the state-of-the-art, machine learning algorithms need to reduce the false-alarm rates at which they are capable of detecting signals and extend their validity to regions of parameter space where modeled searches are computationally expensive to run. Based on our findings we compile a list of research areas that we believe are the most important to elevate machine learning searches to an invaluable tool in gravitational-wave signal detection.
arXiv comment25 pages, 6 figures, 4 tables, additional material available at https://github.com/gwastro/ml-mock-data-challenge-1
References in corpus (94)
- XGBoost: A Scalable Tree Boosting System
- Observation of Gravitational Waves from a Binary Black Hole Merger
- GW170817: Observation of Gravitational Waves from a Binary Neutron Star Inspiral
- Advanced Virgo: a 2nd generation interferometric gravitational wave detector
- GWTC-1: A Gravitational-Wave Transient Catalog of Compact Binary Mergers Observed by LIGO and Virgo during the First and Second Observing Runs
- Advanced LIGO
- GWTC-2: Compact Binary Coalescences Observed by LIGO and Virgo During the First Half of the Third Observing Run
- Characterization of the LIGO detectors during their sixth science run
- Frequency-domain gravitational waves from non-precessing black-hole binaries. I. New numerical waveforms and anatomy of the signal
- The PyCBC search for gravitational waves from compact binary coalescence
- FINDCHIRP: an algorithm for detection of gravitational waves from inspiraling compact binaries
- An improved effective-one-body model of spinning, nonprecessing binary black holes for the era of gravitational-wave astrophysics with advanced detectors
- Computationally efficient models for the dominant and sub-dominant harmonic modes of precessing binary black holes
- Open data from the first and second observing runs of Advanced LIGO and Advanced Virgo
- KAGRA: 2.5 Generation Interferometric Gravitational Wave Detector
- Method for detection and reconstruction of gravitational wave transients with networks of advanced detectors
- Towards models of gravitational waveforms from generic binaries II: Modelling precession effects with a single effective precession parameter
- Analysis Framework for the Prompt Discovery of Compact Binary Mergers in Gravitational-wave Data
- A guide to LIGO-Virgo detector noise and extraction of transient gravitational-wave signals
- A chi-squared time-frequency discriminator for gravitational wave detection
- Deep Learning for Real-time Gravitational Wave Detection and Parameter Estimation: Results with Advanced LIGO Data
- Characterization of transient noise in Advanced LIGO relevant to gravitational wave signal GW150914
- New binary black hole mergers in the second observing run of Advanced LIGO and Advanced Virgo
- Gravity Spy: Integrating Advanced LIGO Detector Characterization, Machine Learning, and Citizen Science
- Deep Neural Networks to Enable Real-time Multimessenger Astrophysics
- Real-time gravitational-wave science with neural posterior estimation
- Measuring the binary black hole mass spectrum with an astrophysically motivated parameterization
- Matching matched filtering with deep networks in gravitational-wave astronomy
- 2-OGC: Open Gravitational-wave Catalog of binary mergers from analysis of public Advanced LIGO and Virgo data
- Detecting binary compact-object mergers with gravitational waves: Understanding and Improving the sensitivity of the PyCBC search
- Bayesian parameter estimation using conditional variational autoencoders for gravitational-wave astronomy
- 1-OGC: The first open gravitational-wave catalog of binary mergers from analysis of public Advanced LIGO data
- 3-OGC: Catalog of gravitational waves from compact-binary mergers
- Observing gravitational-wave transient GW150914 with minimal assumptions
- Constraint Likelihood analysis for a network of gravitational wave detectors
- Low-latency analysis pipeline for compact binary coalescences in the advanced gravitational wave detector era
- A New Search Pipeline for Compact Binary Mergers: Results for Binary Black Holes in the First Observing Run of Advanced LIGO
- Deep Transfer Learning: A new deep learning glitch classification method for advanced LIGO
- Glitch Classification and Clustering for LIGO with Deep Transfer Learning
- Enhancing Gravitational-Wave Science with Machine Learning
- Search for gravitational waves from binary inspirals in S3 and S4 LIGO data
- PyCBC Live: Rapid Detection of Gravitational Waves from Compact Binary Mergers
- Searching for Gravitational Waves from Compact Binaries with Precessing Spins
- Convolutional neural networks: a magic bullet for gravitational-wave detection?
- An information-theoretic approach to the gravitational-wave burst detection problem
- Nested Sampling with Normalising Flows for Gravitational-Wave Inference
- Learning Bayesian posteriors with neural networks for gravitational-wave inference
- Blip glitches in Advanced LIGO data
- Extending the PyCBC search for gravitational waves from compact binary mergers to a global network
- Real-Time Detection of Gravitational Waves from Binary Neutron Stars using Artificial Neural Networks
- Gravitational waves from inspiralling compact binaries: hexagonal template placement and its efficiency in detecting physical signals
- Coherent WaveBurst, a pipeline for unmodeled gravitational-wave data analysis
- Distinguishing short duration noise transients in LIGO data to improve the PyCBC search for gravitational waves from high mass binary black hole mergers
- Realtime search for compact binary mergers in Advanced LIGO and Virgo's third observing run using PyCBC Live
- Review of the Advanced LIGO gravitational wave observatories leading to observing run four
- Deep-Learning continuous gravitational waves
- Searching for the full symphony of black hole binary mergers
- Gravitational wave signal recognition of O1 data by deep learning
- Improving the Data Quality of Advanced LIGO Based on Early Engineering Run Results
- Applications and Techniques for Fast Machine Learning in Science
- Search for Eccentric Binary Neutron Star Mergers in the first and second observing runs of Advanced LIGO
- How effective is machine learning to detect long transient gravitational waves from neutron stars in a real search?
- Detection of gravitational-wave signals from binary neutron star mergers using machine learning
- Accelerated, Scalable and Reproducible AI-driven Gravitational Wave Detection
- Broad search for gravitational waves from subsolar-mass binaries through LIGO and Virgo's third observing run
- Gravitational-wave surrogate models powered by artificial neural networks: The ANN-Sur for waveform generation
- Detection and Parameter Estimation of Gravitational Waves from Binary Neutron-Star Mergers in Real LIGO Data using Deep Learning
- Deep learning for clustering of continuous gravitational wave candidates
- Deep Learning Ensemble for Real-time Gravitational Wave Detection of Spinning Binary Black Hole Mergers
- Deep-Learning Continuous Gravitational Waves: Multiple detectors and realistic noise
- Deep learning for gravitational wave forecasting of neutron star mergers
- A Machine Learning Based Source Property Inference for Compact Binary Mergers
- Training Strategies for Deep Learning Gravitational-Wave Searches
- Finding Symmetry Breaking Order Parameters with Euclidean Neural Networks
- Denoising Gravitational Waves with Enhanced Deep Recurrent Denoising Auto-Encoders
- Denoising Gravitational Waves using Deep Learning with Recurrent Denoising Autoencoders
- Using Deep Learning to Localize Gravitational Wave Sources
- From One to Many: A Deep Learning Coincident Gravitational-Wave Search
- First gravitational-wave search for intermediate-mass black hole mergers with higher order harmonics
- Anomaly Detection in Gravitational Waves data using Convolutional AutoEncoders
- Optimization of model independent gravitational wave search using machine learning
- Inference-optimized AI and high performance computing for gravitational wave detection at scale
- Improving significance of binary black hole mergers in Advanced LIGO data using deep learning : Confirmation of GW151216
- Deep Learning with Quantized Neural Networks for Gravitational Wave Forecasting of Eccentric Compact Binary Coalescence
- GWSkyNet: a real-time classifier for public gravitational-wave candidates
- Deep learning for clustering of continuous gravitational wave candidates II: identification of low-SNR candidates
- Utilizing Gaussian mixture models in all-sky searches for short-duration gravitational wave bursts
- Search for binary black hole mergers in the third observing run of Advanced LIGO-Virgo using coherent WaveBurst enhanced with machine learning
- Convolutional neural network for gravitational-wave early alert: Going down in frequency
- Hierarchical approach to matched filtering using a reduced basis
- Incorporating information from LIGO data quality streams into the PyCBC search for gravitational waves
- Assessing the impact of non-Gaussian noise on convolutional neural networks that search for continuous gravitational waves
- Sensitivity of spin-aligned searches for neutron star-black hole systems using future detectors
- AI and extreme scale computing to learn and infer the physics of higher order gravitational wave modes of quasi-circular, spinning, non-precessing binary black hole mergers
Cited by in corpus (34)
- The Science of the Einstein Telescope
- Deep Residual Networks for Gravitational Wave Detection
- Deep Learning Detection and Classification of Gravitational Waves from Neutron Star-Black Hole Mergers
- New Gravitational Wave Discoveries Enabled by Machine Learning
- Applications of machine learning in gravitational wave research with current interferometric detectors
- Real-Time Detection of Unmodelled Gravitational-Wave Transients Using Convolutional Neural Networks
- Numerical relativity higher order gravitational waveforms of eccentric, spinning, non-precessing binary black hole mergers
- Searches for Mass-Asymmetric Compact Binary Coalescence Events using Neural Networks in the LIGO/Virgo Third Observation Period
- Premerger detection of massive black hole binaries using deep learning
- Comparative study of 1D and 2D convolutional neural network models with attribution analysis for gravitational wave detection from compact binary coalescences
- Decoding Long-duration Gravitational Waves from Binary Neutron Stars with Machine Learning: Parameter Estimation and Equations of State
- Neural network time-series classifiers for gravitational-wave searches in single-detector periods
- Parameter estimation of microlensed gravitational waves with Conditional Variational Autoencoders
- Rapid identification of time-frequency domain gravitational wave signals from binary black holes using deep learning
- Convolutional Neural Networks for signal detection in real LIGO data
- Searching for gravitational waves from stellar-mass binary black holes early inspiral
- Novel neural-network architecture for continuous gravitational waves
- Reconstruction of binary black hole harmonics in LIGO using deep learning
- Deep-Learning Classification and Parameter Inference of Rotational Core-Collapse Supernovae
- Navigating Unknowns: Deep Learning Robustness for Gravitational Wave Signal Reconstruction
- Binary Neutron Star Merger Search Pipeline Powered by Deep Learning
- New approach to template banks of gravitational waves with higher harmonics: Reducing matched-filtering cost by over an order of magnitude
- Novel Deep Learning Approach to Detecting Binary Black Hole Mergers
- Identifying and Mitigating Machine Learning Biases for the Gravitational Wave Detection Problem
- Comparison of neural network architectures for feature extraction from binary black hole merger waveforms
- Physics-inspired spatiotemporal-graph AI ensemble for the detection of higher order wave mode signals of spinning binary black hole mergers
- Beyond FINDCHIRP: Breaking the memory wall and optimal FFTs for Gravitational-Wave Matched-Filter Searches with Ratio-Filter Dechirping
- Search for exotic gravitational wave signals beyond general relativity using deep learning
- Learning and Interpreting Gravitational-Wave Features from CNNs with a Random Forest Approach
- Machine Learning Confirms GW231123 is a "Lite" Intermediate Mass Black Hole Merger
- Learning to detect continuous gravitational waves: an open data-analysis competition
- Towards an anomaly detection pipeline for gravitational waves at the Einstein Telescope
- Parameter inference of millilensed gravitational waves using neural spline flows
- Unveiling gravitational waves from core-collapse supernovae with MUSE