Machine-directed gravitational-wave counterpart discovery

Abstract

Joint observations in electromagnetic and gravitational waves shed light on the physics of objects and surrounding environments with extreme gravity that are otherwise unreachable via siloed observations in each messenger. However, such detections remain challenging due to the rapid and faint nature of counterparts. Protocols for discovery and inference still rely on human experts manually inspecting survey alert streams and intuiting optimal usage of limited follow-up resources. Strategizing an optimal follow-up program requires adaptive sequential decision-making given evolving light curve data that (i) maximizes a global objective despite incomplete information and (ii) is robust to stochasticity introduced by detectors/observing conditions. Reinforcement learning (RL) approaches allow agents to implicitly learn the physics/detector dynamics and the behavior policy that maximize a designated objective through experience. To demonstrate the utility of such an approach for the kilonova follow-up problem, we train a toy RL agent for the goal of maximizing follow-up photometry for the true kilonova among several contaminant transient light curves. In a simulated environment where the agent learns online, it achieves 3x higher accuracy compared to a random strategy. However, it is surpassed by human agents by up to a factor of 2. This is likely because our hypothesis function (Q that is linear in state-action features) is an insufficient representation of the optimal behavior policy. More complex agents could perform at par or surpass human experts. Agents like these could pave the way for machine-directed software infrastructure to efficiently respond to next generation detectors, for conducting science inference and optimally planning expensive follow-up observations, scalably and with demonstrable performance guarantees.

Accepted to the Astrophysical Journal; DOI: 10.3847/1538-4357/ad7257

References in corpus (25)

• GW170817: Observation of Gravitational Waves from a Binary Neutron Star Inspiral
• The Astropy Project: Sustaining and Growing a Community-oriented Open-source Project and the Latest Major Release (v5.0) of the Core Package
• Advanced Virgo: a 2nd generation interferometric gravitational wave detector
• Advanced LIGO
• The Zwicky Transient Facility: System Overview, Performance, and First Results
• The Zwicky Transient Facility: Data Processing, Products, and Archive
• Origin of the heavy elements in binary neutron-star mergers from a gravitational wave event
• Swope Supernova Survey 2017a (SSS17a), the Optical Counterpart to a Gravitational Wave Source
• The All-Sky Automated Survey for Supernovae (ASAS-SN) Light Curve Server v1.0
• A kilonova as the electromagnetic counterpart to a gravitational-wave source
• The Zwicky Transient Facility: Science Objectives
• Light Curves of the Neutron Star Merger GW170817/SSS17a: Implications for R-Process Nucleosynthesis
• Illuminating Gravitational Waves: A Concordant Picture of Photons from a Neutron Star Merger
• GW170817: Joint Constraint on the Neutron Star Equation of State from Multimessenger Observations
• Neutron-star radius constraints from GW170817 and future detections
• Kilonovae
• The Zwicky Transient Facility: Observing System
• The Koala: A Fast Blue Optical Transient with Luminous Radio Emission from a Starburst Dwarf Galaxy at $z=0.27$
• Optical follow-up of the neutron star-black hole mergers S200105ae and S200115j
• A data science platform to enable time-domain astronomy
• The unblinking eye on the sky
• Updated observing scenarios and multi-messenger implications for the International Gravitational-wave Network's O4 and O5
• The Needle in the 100 deg2 Haystack: Uncovering Afterglows of Fermi GRBs with the Palomar Transient Factory
• ANTARES: A Prototype Transient Broker System
• An Information Theory Approach on Deciding Spectroscopic Follow Ups

Cited by in corpus (1)

• Application of Non-Linear Noise Regression in the Virgo Detector