ORAC-DR: A generic data reduction pipeline infrastructure

Abstract

ORAC-DR is a general purpose data reduction pipeline system designed to be instrument and observatory agnostic. The pipeline works with instruments as varied as infrared integral field units, imaging arrays and spectrographs, and sub-millimeter heterodyne arrays & continuum cameras. This paper describes the architecture of the pipeline system and the implementation of the core infrastructure. We finish by discussing the lessons learned since the initial deployment of the pipeline system in the late 1990s.

11 pages, 1 figure, accepted for publication in Astronomy and Computing

References in corpus (4)

• SCUBA-2: iterative map-making with the Sub-Millimetre User Reduction Facility
• Learning from 25 years of the extensible N-Dimensional Data Format
• An overview of the planned CCAT software system
• Your data is your dogfood: DevOps in the astronomical observatory

Cited by in corpus (8)

• The Superluminous Transient ASASSN-15lh as a Tidal Disruption Event from a Kerr Black Hole
• Energetic eruptions leading to a peculiar hydrogen-rich explosion of a massive star
• SONS: The JCMT legacy survey of debris discs in the submillimetre
• Early observations of the nearby type Ia supernova SN 2015F
• The perihelion activity of comet 67P/Churyumov-Gerasimenko as seen by robotic telescopes
• Learning from 25 years of the extensible N-Dimensional Data Format
• Reimplementing the Hierarchical Data System using HDF5
• Observatory/data centre partnerships and the VO-centric archive: The JCMT Science Archive experience