231 citations · 352 across the 10 of their papers we have counts for
10 papers · 1 filter
Integrating the PanDA Workload Management System with the Vera C. Rubin Observatory
Edward Karavakis, Wen Guan, Zhaoyu Yang +16
The Vera C. Rubin Observatory will produce an unprecedented astronomical data set for studies of the deep and dynamic universe. Its Legacy Survey of Space and Time (LSST) will imag…
Data management and execution systems for the Rubin Observatory Science Pipelines
Nate B. Lust, Tim Jenness, James F. Bosch +7
We present the Rubin Observatory system for data storage/retrieval and pipelined code execution. The layer for data storage and retrieval is named the Butler. It consists of a rela…
Adding Workflow Management Flexibility to LSST Pipelines Execution
Michelle Gower, Mikolaj Kowalik, Nate B. Lust +2
Data processing pipelines need to be executed at scales ranging from small runs up through large production data release runs resulting in millions of data products. As part of the…
The Vera C. Rubin Observatory Data Butler and Pipeline Execution System
Tim Jenness, James F. Bosch, Nate B. Lust +6
The Rubin Observatory's Data Butler is designed to allow data file location and file formats to be abstracted away from the people writing the science pipeline algorithms. The Butl…
Rubin Science Platform on Google: the story so far
William O'Mullane, Frossie Economou, Flora Huang +16
We describe Rubin Observatory's experience with offering a data access facility (and associated services including our Science Platform) deployed on Google Cloud infrastructure as…
Abstracting the storage and retrieval of image data at the LSST
Tim Jenness, James F. Bosch, Pim Schellart +3
Writing generic data processing pipelines requires that the algorithmic code does not ever have to know about data formats of files, or the locations of those files. At LSST we hav…