ORAC-DR: A generic data reduction pipeline infrastructure

Abstract

ORAC-DR is a general purpose data reduction pipeline system designed to be instrument and observatory agnostic. The pipeline works with instruments as varied as infrared integral field units, imaging arrays and spectrographs, and sub-millimeter heterodyne arrays & continuum cameras. This paper describes the architecture of the pipeline system and the implementation of the core infrastructure. We finish by discussing the lessons learned since the initial deployment of the pipeline system in the late 1990s.

11 pages, 1 figure, accepted for publication in Astronomy and Computing

References in corpus (11)

• Astropy: A Community Python Package for Astronomy
• Las Cumbres Observatory Global Telescope Network
• SCUBA: A common-user submillimetre camera operating on the James Clerk Maxwell Telescope
• SCUBA-2: The 10000 pixel bolometer camera on the James Clerk Maxwell Telescope
• SCUBA-2: iterative map-making with the Sub-Millimetre User Reduction Facility
• HARP/ACSIS: A submillimetre spectral imaging system on the James Clerk Maxwell Telescope
• Automated reduction of submillimetre single-dish heterodyne data from the James Clerk Maxwell Telescope using ORAC-DR
• Learning from 25 years of the extensible N-Dimensional Data Format
• An overview of the planned CCAT software system
• Your data is your dogfood: DevOps in the astronomical observatory
• Data Management At the UKIRT and JCMT

Cited by in corpus (23)

• The diversity of Type II supernova versus the similarity in their progenitors
• The Superluminous Transient ASASSN-15lh as a Tidal Disruption Event from a Kerr Black Hole
• Energetic eruptions leading to a peculiar hydrogen-rich explosion of a massive star
• Type Ibn Supernovae Show Photometric Homogeneity and Spectral Diversity at Maximum Light
• SONS: The JCMT legacy survey of debris discs in the submillimetre
• Early observations of the nearby type Ia supernova SN 2015F
• Automated reduction of submillimetre single-dish heterodyne data from the James Clerk Maxwell Telescope using ORAC-DR
• CHIMPS2: Survey description and ${}^{12}$CO emission in the Galactic Centre
• The perihelion activity of comet 67P/Churyumov-Gerasimenko as seen by robotic telescopes
• LSQ13ddu: A rapidly-evolving stripped-envelope supernova with early circumstellar interaction signatures
• Learning from 25 years of the extensible N-Dimensional Data Format
• 12CO (3-2) High-Resolution Survey (COHRS) of the Galactic Plane: Complete Data Release
• Reimplementing the Hierarchical Data System using HDF5
• Submillimeter pulsations from the magnetar XTE J1810-197
• Determining star formation rates of active galactic nuclei host galaxies based on SED fitting with sub-mm data
• The HASHTAG project I. A Survey of CO(3-2) Emission from the Star Forming Disc of M31
• Observatory/data centre partnerships and the VO-centric archive: The JCMT Science Archive experience
• The SCUBA-2 Ambitious Sky Survey: a catalogue of beam-sized sources in the Galactic longitude range 120 to 140
• The Nearby Evolved Stars Survey: I. JCMT/SCUBA-2 Sub-millimetre detection of the detached shell of U Antliae
• WISDOM project -- XVIII. Molecular gas distributions and kinematics of three megamaser galaxies
• Abstracting the storage and retrieval of image data at the LSST
• CHIMPS2: ${}^{13}$CO $J=3\to 2$ emission in the Central Molecular Zone
• Implementing Remote Observing at the JCMT