BOSS-LDG: A Novel Computational Framework that Brings Together Blue Waters, Open Science Grid, Shifter and the LIGO Data Grid to Accelerate Gravitational Wave Discovery

Abstract

We present a novel computational framework that connects Blue Waters, the NSF-supported, leadership-class supercomputer operated by NCSA, to the Laser Interferometer Gravitational-Wave Observatory (LIGO) Data Grid via Open Science Grid technology. To enable this computational infrastructure, we configured, for the first time, a LIGO Data Grid Tier-1 Center that can submit heterogeneous LIGO workflows using Open Science Grid facilities. In order to enable a seamless connection between the LIGO Data Grid and Blue Waters via Open Science Grid, we utilize Shifter to containerize LIGO's workflow software. This work represents the first time Open Science Grid, Shifter, and Blue Waters are unified to tackle a scientific problem and, in particular, it is the first time a framework of this nature is used in the context of large scale gravitational wave data analysis. This new framework has been used in the last several weeks of LIGO's second discovery campaign to run the most computationally demanding gravitational wave search workflows on Blue Waters, and accelerate discovery in the emergent field of gravitational wave astrophysics. We discuss the implications of this novel framework for a wider ecosystem of Higher Performance Computing users.

arXiv comment10 pages, 10 figures. Accepted as a Full Research Paper to the 13th IEEE International Conference on eScience

References in corpus (20)

• Observation of Gravitational Waves from a Binary Black Hole Merger
• Advanced LIGO
• GW151226: Observation of Gravitational Waves from a 22-Solar-Mass Binary Black Hole Coalescence
• GW170104: Observation of a 50-Solar-Mass Binary Black Hole Coalescence at Redshift 0.2
• Evolution of Binary Black Hole Spacetimes
• Robust parameter estimation for compact binaries with ground-based gravitational-wave observations using the LALInference software library
• GW150914: The Advanced LIGO Detectors in the Era of First Discoveries
• The PyCBC search for gravitational waves from compact binary coalescence
• Method for detection and reconstruction of gravitational wave transients with networks of advanced detectors
• BayesWave: Bayesian Inference for Gravitational Wave Bursts and Instrument Glitches
• A catalog of 174 binary black-hole simulations for gravitational-wave astronomy
• Georgia Tech Catalog of Gravitational Waveforms
• Testing gravitational-wave searches with numerical relativity waveforms: Results from the first Numerical INJection Analysis (NINJA) project
• Complete waveform model for compact binaries on eccentric orbits
• Improving the sensitivity of a search for coalescing binary black holes with non-precessing spins in gravitational wave data
• The NINJA-2 catalog of hybrid post-Newtonian/numerical-relativity waveforms for non-precessing black-hole binaries
• The RIT binary black hole simulations catalog
• The NINJA-2 project: Detecting and characterizing gravitational waveforms modelled using numerical binary black hole simulations
• Workload Analysis of Blue Waters
• Data Access for LIGO on the OSG

Cited by in corpus (7)

• Coherent WaveBurst, a pipeline for unmodeled gravitational-wave data analysis
• Enabling real-time multi-messenger astrophysics discoveries with deep learning
• Accelerated, Scalable and Reproducible AI-driven Gravitational Wave Detection
• Container solutions for HPC Systems: A Case Study of Using Shifter on Blue Waters
• Supporting High-Performance and High-Throughput Computing for Experimental Science
• Real-time regression analysis with deep convolutional neural networks
• Statistically-informed deep learning for gravitational wave parameter estimation