Enabling real-time multi-messenger astrophysics discoveries with deep learning

Abstract

Multi-messenger astrophysics is a fast-growing, interdisciplinary field that combines data, which vary in volume and speed of data processing, from many different instruments that probe the Universe using different cosmic messengers: electromagnetic waves, cosmic rays, gravitational waves and neutrinos. In this Expert Recommendation, we review the key challenges of real-time observations of gravitational wave sources and their electromagnetic and astroparticle counterparts, and make a number of recommendations to maximize their potential for scientific discovery. These recommendations refer to the design of scalable and computationally efficient machine learning algorithms; the cyber-infrastructure to numerically simulate astrophysical sources, and to process and interpret multi-messenger astrophysics data; the management of gravitational wave detections to trigger real-time alerts for electromagnetic and astroparticle follow-ups; a vision to harness future developments of machine learning and cyber-infrastructure resources to cope with the big-data requirements; and the need to build a community of experts to realize the goals of multi-messenger astrophysics.

Invited Expert Recommendation for Nature Reviews Physics. The art work produced by E. A. Huerta and Shawn Rosofsky for this article was used by Carl Conway to design the cover of the October 2019 issue of Nature Reviews Physics

References in corpus (80)

• GW170817: Observation of Gravitational Waves from a Binary Neutron Star Inspiral
• GWTC-1: A Gravitational-Wave Transient Catalog of Compact Binary Mergers Observed by LIGO and Virgo during the First and Second Observing Runs
• SDSS-III: Massive Spectroscopic Surveys of the Distant Universe, the Milky Way Galaxy, and Extra-Solar Planetary Systems
• Large Magellanic Cloud Cepheid Standards Provide a 1% Foundation for the Determination of the Hubble Constant and Stronger Evidence for Physics Beyond LambdaCDM
• A gravitational-wave standard siren measurement of the Hubble constant
• Neutrino emission from the direction of the blazar TXS 0506+056 prior to the IceCube-170922A alert
• Early Dark Energy Can Resolve The Hubble Tension
• The Dark Energy Survey: more than dark energy - an overview
• The Electromagnetic Counterpart of the Binary Neutron Star Merger LIGO/VIRGO GW170817. II. UV, Optical, and Near-IR Light Curves and Comparison to Kilonova Models
• Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equations
• Light Curves of the Neutron Star Merger GW170817/SSS17a: Implications for R-Process Nucleosynthesis
• On the Nature of Core Collapse Supernova Explosions
• A unified deep artificial neural network approach to partial differential equations in complex geometries
• The Einstein Toolkit: A Community Computational Infrastructure for Relativistic Astrophysics
• Opacities and Spectra of the r-process Ejecta from Neutron Star Mergers
• Neural Ordinary Differential Equations
• Binary neutron-star mergers: a review of Einstein's richest laboratory
• What is the Most Promising Electromagnetic Counterpart of a Neutron Star Binary Merger?
• Matched filtering of gravitational waves from inspiraling compact binaries: Computational cost and template placement
• Binary Neutron Star Mergers: Mass Ejection, Electromagnetic Counterparts and Nucleosynthesis
• Physics of Core-Collapse Supernovae in Three Dimensions: a Sneak Preview
• Improving galaxy morphologies for SDSS with Deep Learning
• A mildly relativistic wide-angle outflow in the neutron star merger GW170817
• Deep Learning for Real-time Gravitational Wave Detection and Parameter Estimation: Results with Advanced LIGO Data
• The Physics of Core-Collapse Supernovae
• First measurement of the Hubble constant from a dark standard siren using the Dark Energy Survey galaxies and the LIGO/Virgo binary-black-hole merger GW170814
• Sub-grid modelling for two-dimensional turbulence using neural networks
• Deep Neural Networks to Enable Real-time Multimessenger Astrophysics
• Long-term GRMHD Simulations of Neutron Star Merger Accretion Disks: Implications for Electromagnetic Counterparts
• Deep Fluids: A Generative Network for Parameterized Fluid Simulations
• Matching matched filtering with deep networks in gravitational-wave astronomy
• A Convolutional Neural Network Neutrino Event Classifier
• A standard siren measurement of the Hubble constant from GW170817 without the electromagnetic counterpart
• Binary neutron star mergers: a jet engine for short gamma-ray bursts
• Estimating the Contribution of Dynamical Ejecta in the Kilonova Associated with GW170817
• Three-dimensional GRMHD simulations of neutrino-cooled accretion disks from neutron star mergers
• THC: a new high-order finite-difference high-resolution shock-capturing code for special-relativistic hydrodynamics
• Characterizing the Gravitational Wave Signal from Core-Collapse Supernovae
• Observing gravitational-wave transient GW150914 with minimal assumptions
• Deep Transfer Learning: A new deep learning glitch classification method for advanced LIGO
• Glitch Classification and Clustering for LIGO with Deep Transfer Learning
• Relativistic simulations of black hole-neutron star coalescence: the jet emerges
• Neutron Star Mergers as sites of r-process Nucleosynthesis and Short Gamma-Ray Bursts
• R-process Nucleosynthesis from Three-Dimensional Magnetorotational Core-Collapse Supernovae
• Results from the Supernova Photometric Classification Challenge
• SkyNet: A modular nuclear reaction network library
• Observing Gravitational Waves from Core-Collapse Supernovae in the Advanced Detector Era
• Three-Dimensional Supernova Explosion Simulations of 9-, 10-, 11-, 12-, and 13-M${}_{\odot }$ Stars
• Measuring Dark Energy Properties with Photometrically Classified Pan-STARRS Supernovae. II. Cosmological Parameters
• Searching for Gravitational Waves from Compact Binaries with Precessing Spins
• Complete waveform model for compact binaries on eccentric orbits
• Producing Magnetar Magnetic Fields in the Merger of Binary Neutron Stars
• The Astrophysical Multimessenger Observatory Network (AMON)
• Gravitational Wave Denoising of Binary Black Hole Mergers with Deep Learning
• Optical Follow-up of Gravitational-wave Events with Las Cumbres Observatory
• Machine Learning-based Brokers for Real-time Classification of the LSST Alert Stream
• Reduced-order modeling with artificial neurons for gravitational-wave inference
• Deep-Learning continuous gravitational waves
• Distinguishing the nature of comparable-mass neutron star binary systems with multimessenger observations: GW170817 case study
• Numerical Relativity of Compact Binaries in the 21st Century
• How Many Kilonovae Can Be Found in Past, Present, and Future Survey Datasets?
• Neutrino-Driven Convection in Core-Collapse Supernovae: High-Resolution Simulations
• Optimizing searches for electromagnetic counterparts of gravitational wave triggers
• Community Organizations: Changing the Culture in Which Research Software Is Developed and Sustained
• Deep Learning at Scale for the Construction of Galaxy Catalogs in the Dark Energy Survey
• Effective Image Differencing with ConvNets for Real-time Transient Hunting
• Denoising Gravitational Waves with Enhanced Deep Recurrent Denoising Auto-Encoders
• Denoising Gravitational Waves using Deep Learning with Recurrent Denoising Autoencoders
• Comparison of various methods to extract ringdown frequency from gravitational wave data
• Serendipitous Discoveries of Kilonovae in the LSST Main Survey: Maximising Detections of Sub-Threshold Gravitational Wave Events
• Fusing numerical relativity and deep learning to detect higher-order multipole waveforms from eccentric binary black hole mergers
• Evolution of the Magnetized, Neutrino-Cooled Accretion Disk in the Aftermath of a Black Hole Neutron Star Binary Merger
• Mary, a pipeline to aid discovery of optical transients
• Graph Neural Networks for IceCube Signal Classification
• BOSS-LDG: A Novel Computational Framework that Brings Together Blue Waters, Open Science Grid, Shifter and the LIGO Data Grid to Accelerate Gravitational Wave Discovery
• Supporting High-Performance and High-Throughput Computing for Experimental Science
• Multi-Messenger Astrophysics: Harnessing the Data Revolution
• Strategic Plan for a Scientific Software Innovation Institute (S2I2) for High Energy Physics
• Astro 2020 Science White Paper: Joint Gravitational Wave and Electromagnetic Astronomy with LIGO and LSST in the 2020's
• Data Access for LIGO on the OSG

Cited by in corpus (42)

• Single chip photonic deep neural network with accelerated training
• Enhancing Gravitational-Wave Science with Machine Learning
• Real-Time Detection of Gravitational Waves from Binary Neutron Stars using Artificial Neural Networks
• Accelerated, Scalable and Reproducible AI-driven Gravitational Wave Detection
• Convergence of Artificial Intelligence and High Performance Computing on NSF-supported Cyberinfrastructure
• Detection and Parameter Estimation of Gravitational Waves from Binary Neutron-Star Mergers in Real LIGO Data using Deep Learning
• FAIR principles for AI models with a practical application for accelerated high energy diffraction microscopy
• Detecting Gravitational-waves from Extreme Mass Ratio Inspirals using Convolutional Neural Networks
• Deep learning for gravitational wave forecasting of neutron star mergers
• Applications of physics informed neural operators
• Hints of dark energy anisotropic stress using Machine Learning
• Physics-Driven Learning for Inverse Problems in Quantum Chromodynamics
• Exploring compact binary merger host galaxies and environments with $\mathrm{zELDA}$
• Machine learning forecasts of the cosmic distance duality relation with strongly lensed gravitational wave events
• Optimization of model independent gravitational wave search using machine learning
• Inference-optimized AI and high performance computing for gravitational wave detection at scale
• Ensemble of Deep Convolutional Neural Networks for real-time gravitational wave signal recognition
• Deep Learning with Quantized Neural Networks for Gravitational Wave Forecasting of Eccentric Compact Binary Coalescence
• Physics-inspired deep learning to characterize the signal manifold of quasi-circular, spinning, non-precessing binary black hole mergers
• Deep Learning for Cardiologist-level Myocardial Infarction Detection in Electrocardiograms
• Luminal Propagation of Gravitational Waves in Scalar-tensor Theories: The Case for Torsion
• Inferencing Progenitor and Explosion Properties of Evolving Core-collapse Supernovae from Zwicky Transient Facility Light Curves
• Real-Time Value-Driven Data Augmentation in the Era of LSST
• Power-law Scaling to Assist with Key Challenges in Artificial Intelligence
• Artificial neural network subgrid models of 2-D compressible magnetohydrodynamic turbulence
• Gravitational lensing of massive particles by a black-bounce-Schwarzschild black hole
• Interpretable AI forecasting for numerical relativity waveforms of quasi-circular, spinning, non-precessing binary black hole mergers
• Advances in Machine and Deep Learning for Modeling and Real-time Detection of Multi-Messenger Sources
• APACE: AlphaFold2 and advanced computing as a service for accelerated discovery in biophysics
• Data-driven detection of multi-messenger transients
• Deep-Learning Classification and Parameter Inference of Rotational Core-Collapse Supernovae
• AI and extreme scale computing to learn and infer the physics of higher order gravitational wave modes of quasi-circular, spinning, non-precessing binary black hole mergers
• Comparison of neural network architectures for feature extraction from binary black hole merger waveforms
• Physics-inspired spatiotemporal-graph AI ensemble for the detection of higher order wave mode signals of spinning binary black hole mergers
• Deep learning-based astronomical multimodal data fusion: A comprehensive review
• RADAR-Radio Afterglow Detection and AI-driven Response: A Federated Framework for Gravitational Wave Event Follow-Up
• Statistically-informed deep learning for gravitational wave parameter estimation
• AI ensemble for signal detection of higher order gravitational wave modes of quasi-circular, spinning, non-precessing binary black hole mergers
• Leading-order gravitational time delay of massive particles by a moving Schwarzschild lens
• StreamGuard: Low-Overhead Resilience for Real-time HPC Data Streams
• Strong field gravitational lensing of particles by a black-bounce-Schwarzschild black hole
• A FAIR and AI-ready Higgs boson decay dataset