Reducing and Analyzing the PHAT Survey with the Cloud

Abstract

We discuss the technical challenges we faced and the techniques we used to overcome them when reducing the PHAT photometric data set on the Amazon Elastic Compute Cloud (EC2). We first describe the architecture of our photometry pipeline, which we found particularly efficient for reducing the data in multiple ways for different purposes. We then describe the features of EC2 that make this architecture both efficient to use and challenging to implement. We describe the techniques we adopted to process our data, and suggest ways these techniques may be improved for those interested in trying such reductions in the future. Finally, we summarize the output photometry data products, which are now hosted publicly in two places in two formats. They are in simple fits tables in the high-level science products on MAST, and on a queryable database available through the NOAO Data Lab.

arXiv comment12 pages, 6 figures, accepted for publication in ApJS

References in corpus (19)

• The Sloan Digital Sky Survey: Technical Summary
• The VizieR database of Astronomical Catalogues
• A Catalog of Quasar Properties from SDSS DR7
• The Eighth Data Release of the Sloan Digital Sky Survey: First Data from SDSS-III
• Galaxy Groups in the SDSS DR4: I. The Catalogue and Basic Properties
• GALEX-SDSS-WISE Legacy Catalog (GSWLC): Star Formation Rates, Stellar Masses and Dust Attenuations of 700,000 Low-redshift Galaxies
• SDSS DR7 White Dwarf Catalog
• SDSS Standard Star Catalog for Stripe 82: the Dawn of Industrial 1% Optical Photometry
• Detecting filamentary pattern in the cosmic web: a catalogue of filaments for the SDSS
• The Panchromatic Hubble Andromeda Treasury X. Ultraviolet to Infrared Photometry of 117 Million Equidistant Stars
• DIRECT Distances to Nearby Galaxies Using Detached Eclipsing Binaries and Cepheids. I. Variables in the Field M31B
• The NASA Astrophysics Data System: Overview
• DIRECT Distances to Nearby Galaxies Using Detached Eclipsing Binaries and Cepheids. II. Variables in the Field M31A
• DIRECT Distances to Nearby Galaxies Using Detached Eclipsing Binaries and Cepheids. IX. Variables in the Field M31Y Discovered with Image Subtraction
• A Gaia-PS1-SDSS (GPS1) Proper Motion Catalog Covering 3/4 of the Sky
• DIRECT Distances to Nearby Galaxies Using Detached Eclipsing Binaries and Cepheids. III. Variables in the Field M31C
• DIRECT Distances to Nearby Galaxies Using Detached Eclipsing Binaries and Cepheids. IV. Variables in the Field M31D
• Panchromatic Hubble Andromeda Treasury XIII: The Cepheid period-luminosity relation in M31
• Searching for Stars Closely Encountering with the Solar System Based on Data from the Gaia DR1 and RAVE5 Catalogues

Cited by in corpus (6)

• Massive High-Redshift Quiescent Galaxies With JWST
• A Cloud-based architecture for the Cherenkov Telescope Array observation simulations. Optimisation, design, and results
• Measuring Star-Formation Histories, Distances, and Metallicities with Pixel Color-Magnitude Diagrams I: Model Definition and Mock Tests
• Post-AO high-resolution imaging using the Kraken multi-frame blind deconvolution algorithm
• The Hubble Space Telescope Advanced Camera for Surveys Emission Line Survey of Andromeda. I: Classical Be Stars
• Variable Stars in M31 Stellar Clusters from the Panchromatic Hubble Andromeda Treasury