Deep Neural Networks to Enable Real-time Multimessenger Astrophysics

Abstract

Gravitational wave astronomy has set in motion a scientific revolution. To further enhance the science reach of this emergent field, there is a pressing need to increase the depth and speed of the gravitational wave algorithms that have enabled these groundbreaking discoveries. To contribute to this effort, we introduce Deep Filtering, a new highly scalable method for end-to-end time-series signal processing, based on a system of two deep convolutional neural networks, which we designed for classification and regression to rapidly detect and estimate parameters of signals in highly noisy time-series data streams. We demonstrate a novel training scheme with gradually increasing noise levels, and a transfer learning procedure between the two networks. We showcase the application of this method for the detection and parameter estimation of gravitational waves from binary black hole mergers. Our results indicate that Deep Filtering significantly outperforms conventional machine learning techniques, achieves similar performance compared to matched-filtering while being several orders of magnitude faster thus allowing real-time processing of raw big data with minimal resources. More importantly, Deep Filtering extends the range of gravitational wave signals that can be detected with ground-based gravitational wave detectors. This framework leverages recent advances in artificial intelligence algorithms and emerging hardware architectures, such as deep-learning-optimized GPUs, to facilitate real-time searches of gravitational wave sources and their electromagnetic and astro-particle counterparts.

v3: Added results submitted to PRD on October 18, 2017; incorporated suggestions from the community

References in corpus (28)

• Deep Learning in Neural Networks: An Overview
• GW170817: Observation of Gravitational Waves from a Binary Neutron Star Inspiral
• Advanced Virgo: a 2nd generation interferometric gravitational wave detector
• Multi-messenger Observations of a Binary Neutron Star Merger
• WaveNet: A Generative Model for Raw Audio
• Gravitational Waves and Gamma-rays from a Binary Neutron Star Merger: GW170817 and GRB 170817A
• Advanced LIGO
• Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour
• GW170104: Observation of a 50-Solar-Mass Binary Black Hole Coalescence at Redshift 0.2
• GW170814: A Three-Detector Observation of Gravitational Waves from a Binary Black Hole Coalescence
• GW170608: Observation of a 19-solar-mass Binary Black Hole Coalescence
• Robust parameter estimation for compact binaries with ground-based gravitational-wave observations using the LALInference software library
• An improved effective-one-body model of spinning, nonprecessing binary black holes for the era of gravitational-wave astrophysics with advanced detectors
• BayesWave: Bayesian Inference for Gravitational Wave Bursts and Instrument Glitches
• Deep Learning for Real-time Gravitational Wave Detection and Parameter Estimation: Results with Advanced LIGO Data
• Gravity Spy: Integrating Advanced LIGO Detector Characterization, Machine Learning, and Citizen Science
• The First Two Years of Electromagnetic Follow-Up with Advanced LIGO and Virgo
• Eccentric, nonspinning, inspiral, Gaussian-process merger approximant for the detection and characterization of eccentric binary black hole mergers
• Accurate and efficient waveforms for compact binaries on eccentric orbits
• Uncertainties in Parameters Estimated with Neural Networks: Application to Strong Gravitational Lensing
• Complete waveform model for compact binaries on eccentric orbits
• Deep-HiTS: Rotation Invariant Convolutional Neural Network for Transient Detection
• Distinguishing short duration noise transients in LIGO data to improve the PyCBC search for gravitational waves from high mass binary black hole mergers
• Exploiting Large-Scale Correlations to Detect Continuous Gravitational Waves
• Classification methods for noise transients in advanced gravitational-wave detectors II: performance tests on Advanced LIGO data
• Denoising of gravitational wave signals via dictionary learning algorithms
• Novel Method for Incorporating Model Uncertainties into Gravitational Wave Parameter Estimates
• Wide-Field InfraRed Survey Telescope (WFIRST) Mission and Synergies with LISA and LIGO-Virgo

Cited by in corpus (153)

• Deep Learning-Based Communication Over the Air
• Matching matched filtering with deep networks in gravitational-wave astronomy
• Deep Transfer Learning: A new deep learning glitch classification method for advanced LIGO
• Glitch Classification and Clustering for LIGO with Deep Transfer Learning
• Convolutional neural networks: a magic bullet for gravitational-wave detection?
• Learning Bayesian posteriors with neural networks for gravitational-wave inference
• Surveying the reach and maturity of machine learning and artificial intelligence in astronomy
• Searching for Exoplanets Using Artificial Intelligence
• Real-Time Detection of Gravitational Waves from Binary Neutron Stars using Artificial Neural Networks
• Mapping neutron star data to the equation of state using the deep neural network
• Gravitational Wave Denoising of Binary Black Hole Mergers with Deep Learning
• Weak lensing cosmology with convolutional neural networks on noisy data
• Image-based deep learning for classification of noise transients in gravitational wave detectors
• Reduced-order modeling with artificial neurons for gravitational-wave inference
• Reconstructing Functions and Estimating Parameters with Artificial Neural Networks: A Test with the Hubble Parameter and SNe Ia
• Deep-Learning continuous gravitational waves
• Gravitational wave signal recognition of O1 data by deep learning
• Enabling real-time multi-messenger astrophysics discoveries with deep learning
• Exploring QCD matter in extreme conditions with Machine Learning
• How effective is machine learning to detect long transient gravitational waves from neutron stars in a real search?
• Accelerated, Scalable and Reproducible AI-driven Gravitational Wave Detection
• Methodology study of machine learning for the neutron star equation of state
• Detection of gravitational-wave signals from binary neutron star mergers using machine learning
• Applying deep neural networks to the detection and space parameter estimation of compact binary coalescence with a network of gravitational wave detectors
• MLGWSC-1: The first Machine Learning Gravitational-Wave Search Mock Data Challenge
• Deep learning for multimessenger core-collapse supernova detection
• Detection and Parameter Estimation of Gravitational Waves from Binary Neutron-Star Mergers in Real LIGO Data using Deep Learning
• Extensive Studies of the Neutron Star Equation of State from the Deep Learning Inference with the Observational Data Augmentation
• Efficient Gravitational-wave Glitch Identification from Environmental Data Through Machine Learning
• Deep learning for clustering of continuous gravitational wave candidates
• Deep Learning Ensemble for Real-time Gravitational Wave Detection of Spinning Binary Black Hole Mergers
• The Taiji-TianQin-LISA network: Precisely measuring the Hubble constant using both bright and dark sirens
• Detecting Gravitational-waves from Extreme Mass Ratio Inspirals using Convolutional Neural Networks
• Deep-Learning Continuous Gravitational Waves: Multiple detectors and realistic noise
• A method to search for long duration gravitational wave transients from isolated neutron stars using the generalized FrequencyHough
• Some Optimizations on Detecting Gravitational Wave Using Convolutional Neural Network
• Physics of eccentric binary black hole mergers: A numerical relativity perspective
• Training Strategies for Deep Learning Gravitational-Wave Searches
• On Neural Architectures for Astronomical Time-series Classification with Application to Variable Stars
• Detection of Gravitational Waves Using Bayesian Neural Networks
• Extraction of Binary Black Hole Gravitational Wave Signals from Detector Data Using Deep Learning
• Convolutional neural networks for the detection of the early inspiral of a gravitational-wave signal
• Deep Residual Networks for Gravitational Wave Detection
• Denoising Gravitational Waves using Deep Learning with Recurrent Denoising Autoencoders
• Denoising Gravitational Waves with Enhanced Deep Recurrent Denoising Auto-Encoders
• Using Deep Learning to Localize Gravitational Wave Sources
• Comparison of various methods to extract ringdown frequency from gravitational wave data
• Revisiting the cosmic distance duality relation with machine learning reconstruction methods: the combination of HII galaxies and ultra-compact radio quasars
• Fusing numerical relativity and deep learning to detect higher-order multipole waveforms from eccentric binary black hole mergers
• Improved deep learning techniques in gravitational-wave data analysis
• Early warning of coalescing neutron-star and neutron-star-black-hole binaries from nonstationary noise background using neural networks
• Translating neutron star observations to nuclear symmetry energy via artificial neural networks
• From One to Many: A Deep Learning Coincident Gravitational-Wave Search
• Deep Learning Detection and Classification of Gravitational Waves from Neutron Star-Black Hole Mergers
• Space-based gravitational wave signal detection and extraction with deep neural network
• ECoPANN: A Framework for Estimating Cosmological Parameters using Artificial Neural Networks
• Machine learning forecasts of the cosmic distance duality relation with strongly lensed gravitational wave events
• Generalized Approach to Matched Filtering using Neural Networks
• Optimization of model independent gravitational wave search using machine learning
• Inference-optimized AI and high performance computing for gravitational wave detection at scale
• Morphological classification of compact and extended radio galaxies using convolutional neural networks and data augmentation techniques
• Improving significance of binary black hole mergers in Advanced LIGO data using deep learning : Confirmation of GW151216
• Deep Learning with Quantized Neural Networks for Gravitational Wave Forecasting of Eccentric Compact Binary Coalescence
• Searches for Compact Binary Coalescence Events using Neural Networks in LIGO/Virgo Second Observation Period
• Deep learning for clustering of continuous gravitational wave candidates II: identification of low-SNR candidates
• Simulating Transient Noise Bursts in LIGO with Generative Adversarial Networks
• Recovering the CMB Signal with Machine Learning
• Model-independent test for the cosmic distance duality relation with Pantheon and eBOSS DR16 quasar sample
• Physics-inspired deep learning to characterize the signal manifold of quasi-circular, spinning, non-precessing binary black hole mergers
• Identification of Binary Neutron Star Mergers in Gravitational-Wave Data Using YOLO One-Shot Object Detection
• New Gravitational Wave Discoveries Enabled by Machine Learning
• Deep Learning for Cardiologist-level Myocardial Infarction Detection in Electrocardiograms
• Characterization of numerical relativity waveforms of eccentric binary black hole mergers
• Identification of BASS DR3 Sources as Stars, Galaxies and Quasars by XGBoost
• Active deep learning method for the discovery of objects of interest in large spectroscopic surveys
• Lightning-Fast Gravitational Wave Parameter Inference through Neural Amortization
• Efficient parameter inference for gravitational wave signals in the presence of transient noises using temporal and time-spectral fusion normalizing flow
• Likelihood-free Inference with Mixture Density Network
• Merger-Ringdown Consistency: A New Test of Strong Gravity using Deep Learning
• Neural network-based anomaly detection for high-resolution X-ray spectroscopy
• Use of Excess Power Method and Convolutional Neural Network in All-Sky Search for Continuous Gravitational Waves
• An Introduction to Deep Learning for the Physical Layer
• Classification and Recovery of Radio Signals from Cosmic Ray Induced Air Showers with Deep Learning
• Interpretable AI forecasting for numerical relativity waveforms of quasi-circular, spinning, non-precessing binary black hole mergers
• Real-Time Detection of Unmodelled Gravitational-Wave Transients Using Convolutional Neural Networks
• Foreground model recognition through Neural Networks for CMB B-mode observations
• Analytic Waveforms for Eccentric Gravitational Wave Bursts
• A neural network classifier for electron identification on the DAMPE experiment
• Data Analysis Implications of Moderately Eccentric Gravitational Waves
• The ROAD to discovery: machine learning-driven anomaly detection in radio astronomy spectrograms
• Advances in Machine and Deep Learning for Modeling and Real-time Detection of Multi-Messenger Sources
• Using supervised learning algorithms as a follow-up method in the search of gravitational waves from core-collapse supernovae
• Dilated convolutional neural network for detecting extreme-mass-ratio inspirals
• Swift sky localization of gravitational waves using deep learning seeded importance sampling
• The effect of phased recurrent units in the classification of multiple catalogs of astronomical lightcurves
• Searches for Mass-Asymmetric Compact Binary Coalescence Events using Neural Networks in the LIGO/Virgo Third Observation Period
• SiGMa-Net: Deep learning network to distinguish binary black hole signals from short-duration noise transients
• Machine learning phases and criticalities without using real data for training
• Premerger detection of massive black hole binaries using deep learning
• Ranking Candidate Signals with Machine Learning in Low-Latency Search for Gravitational-Waves from Compact Binary Mergers
• Supporting High-Performance and High-Throughput Computing for Experimental Science
• Towards a robust and reliable deep learning approach for detection of compact binary mergers in gravitational wave data
• Localization of gravitational waves using machine learning
• Comparative study of 1D and 2D convolutional neural network models with attribution analysis for gravitational wave detection from compact binary coalescences
• Neural network time-series classifiers for gravitational-wave searches in single-detector periods
• Visualizing convolutional neural network for classifying gravitational waves from core-collapse supernovae
• Probing nuclear physics with supernova gravitational waves and machine learning
• Realizing the potential of deep neural network for analyzing neutron star observables and dense matter equation of state
• Rapid identification of time-frequency domain gravitational wave signals from binary black holes using deep learning
• Assessing the impact of non-Gaussian noise on convolutional neural networks that search for continuous gravitational waves
• Deep learning for intermittent gravitational wave signals
• Deep learning merger masses estimation from gravitational waves signals in the frequency domain
• Data-driven detection of multi-messenger transients
• Graphics processing unit implementation of the F-statistic for continuous gravitational wave searches
• Mass and tidal parameter extraction from gravitational waves of binary neutron stars mergers using deep learning
• Gravitational Wave Signal Extraction Against Non-Stationary Instrumental Noises with Deep Neural Network
• Machine learning technique for morphological classification of galaxies from SDSS. II. The image-based morphological catalogs of galaxies at 0.02<z<0.1
• Convolutional Neural Networks for signal detection in real LIGO data
• Employing Deep Learning for Detection of Gravitational Waves from Compact Binary Coalescences
• Searching for gravitational waves from stellar-mass binary black holes early inspiral
• Stellar Cluster Detection using GMM with Deep Variational Autoencoder
• Navigating Unknowns: Deep Learning Robustness for Gravitational Wave Signal Reconstruction
• Reconstruction of binary black hole harmonics in LIGO using deep learning
• Identifying extra high frequency gravitational waves generated from oscillons with cuspy potentials using deep neural networks
• AI and extreme scale computing to learn and infer the physics of higher order gravitational wave modes of quasi-circular, spinning, non-precessing binary black hole mergers
• Novel Deep Learning Approach to Detecting Binary Black Hole Mergers
• Compact Binary Coalescence Gravitational Wave Signals Counting and Separation
• Physics-inspired spatiotemporal-graph AI ensemble for the detection of higher order wave mode signals of spinning binary black hole mergers
• Nonlinear noise regression in gravitational-wave detectors with convolutional neural networks
• A novel multi-layer modular approach for real-time fuzzy-identification of gravitational-wave signals
• Harvesting the Lyα forest with convolutional neural networks
• Deep Learning the Forecast of Galactic Cosmic-Ray Spectra
• To Learn or Not to Learn: Deep Learning Assisted Wireless Modem Design
• Search for exotic gravitational wave signals beyond general relativity using deep learning
• Boosting the Efficiency of Parametric Detection with Hierarchical Neural Networks
• Learning and Interpreting Gravitational-Wave Features from CNNs with a Random Forest Approach
• Deciphering the Surprising Variability of A-type Stars Revealed by Kepler
• A Statistician Teaches Deep Learning
• General Fourier expansion of post-Newtonian binary dynamics based on a quasi-Keplerian framework
• Learning to detect continuous gravitational waves: an open data-analysis competition
• Statistically-informed deep learning for gravitational wave parameter estimation
• Genetic-algorithm-optimized neural networks for gravitational wave classification
• Using machine learning to auto-tune chi-squared tests for gravitational wave searches
• Transient Classification in low SNR Gravitational Wave data using Deep Learning
• Searches for Compact Binary Coalescence Events Using Neural Networks in LIGO/Virgo Third Observation Period
• Machine Learning for Nanohertz Gravitational Wave Detection and Parameter Estimation with Pulsar Timing Array
• Extract non-Gaussian Features in Gravitational Wave Observation Data Using Self-Supervised Learning
• Constraints on typical relic gravitational waves based on data of LIGO
• Binary Black Hole Parameter Estimation with Hybrid CNN-Transformer Neural Networks
• Denoising gravitational wave with deep learning in the time-frequency domain
• Unveiling gravitational waves from core-collapse supernovae with MUSE
• Time-domain deep learning filtering of structured atmospheric noise for ground-based millimeter astronomy
• SpecGrav -- Detection of Gravitational Waves using Deep Learning