Automated data processing architecture for the Gemini Planet Imager Exoplanet Survey

Abstract

The Gemini Planet Imager Exoplanet Survey (GPIES) is a multi-year direct imaging survey of 600 stars to discover and characterize young Jovian exoplanets and their environments. We have developed an automated data architecture to process and index all data related to the survey uniformly. An automated and flexible data processing framework, which we term the Data Cruncher, combines multiple data reduction pipelines together to process all spectroscopic, polarimetric, and calibration data taken with GPIES. With no human intervention, fully reduced and calibrated data products are available less than an hour after the data are taken to expedite follow-up on potential objects of interest. The Data Cruncher can run on a supercomputer to reprocess all GPIES data in a single day as improvements are made to our data reduction pipelines. A backend MySQL database indexes all files, which are synced to the cloud, and a front-end web server allows for easy browsing of all files associated with GPIES. To help observers, quicklook displays show reduced data as they are processed in real-time, and chatbots on Slack post observing information as well as reduced data products. Together, the GPIES automated data processing architecture reduces our workload, provides real-time data reduction, optimizes our observing strategy, and maintains a homogeneously reduced dataset to study planet occurrence and instrument performance.

21 pages, 3 figures, accepted in JATIS

References in corpus (16)

• The Gemini Planet Imager: First Light
• Fundamental limitations of high contrast imaging set by small sample statistics
• Polarimetry with the Gemini Planet Imager: Methods, Performance at First Light, and the Circumstellar Ring around HR 4796A
• Improving and Assessing Planet Sensitivity of the GPI Exoplanet Survey with a Forward Model Matched Filter
• Reconnaissance of the HR 8799 Exosolar System II: Astrometry and Orbital Motion
• Astrometry and Photometry with Coronagraphs
• Discovery of a Substellar Companion to the Nearby Debris Disk Host HR 2562
• Gemini Planet Imager Observational Calibrations I: Overview of the GPI Data Reduction Pipeline
• Gemini Planet Imager Observational Calibrations VIII: Characterization and Role of Satellite Spots
• Gemini Planet Imager Observational Calibrations V: Astrometry and Distortion
• GPI PSF subtraction with TLOCI: the next evolution in exoplanet/disk high-contrast imaging
• Gemini Planet Imager Observational Calibrations IV: Wavelength Calibration and Flexure Correction for the Integral Field Spectrograph
• Status and performance of the Gemini Planet Imager adaptive optics system
• Gemini Planet Imager Observational Calibrations II: Detector Performance and Calibration
• The Integral Field Spectrograph for the Gemini Planet Imager
• Gemini Planet Imager Observational Calibrations XIV: Polarimetric Contrasts and New Data Reduction Techniques