Intermediate Palomar Transient Factory: Realtime Image Subtraction Pipeline

Abstract

A fast-turnaround pipeline for realtime data reduction plays an essential role in discovering and permitting follow-up observations to young supernovae and fast-evolving transients in modern time-domain surveys. In this paper, we present the realtime image subtraction pipeline in the intermediate Palomar Transient Factory. By using high-performance computing, efficient database, and machine learning algorithms, this pipeline manages to reliably deliver transient candidates within ten minutes of images being taken. Our experience in using high performance computing resources to process big data in astronomy serves as a trailblazer to dealing with data from large-scale time-domain facilities in near future.

arXiv comment18 pages, 6 figures, accepted for publication in PASP

References in corpus (25)

• A method for optimal image subtraction
• The Palomar Transient Factory: System Overview, Performance and First Results
• An extremely luminous X-ray outburst at the birth of a supernova
• Supernova 2011fe from an Exploding Carbon-Oxygen White Dwarf Star
• Seeing the Collision of a Supernova with its Companion Star
• Early supernovae light-curves following the shock-breakout
• A Wolf-Rayet-like progenitor of supernova SN 2013cu from spectral observations of a wind
• Cosmological Constraints from Measurements of Type Ia Supernovae discovered during the first 1.5 years of the Pan-STARRS1 Survey
• Flash Spectroscopy: Emission Lines from the Ionized Circumstellar Material around $<10$-Day-Old Type II Supernovae
• The Sloan Digital Sky Survey-II Supernova Survey: Search Algorithm and Follow-up Observations
• Discovery, Progenitor & Early Evolution of a Stripped Envelope Supernova iPTF13bvn
• The early UV/Optical emission from core-collapse supernovae
• PTF11eon/SN2011dh: Discovery of a Type IIb Supernova From a Compact Progenitor in the Nearby Galaxy M51
• Strong Ultraviolet Pulse From a Newborn Type Ia Supernova
• The Palomar Transient Factory photometric calibration
• The rise of SN2014J in the nearby galaxy M82
• Using Machine Learning for Discovery in Synoptic Survey Imaging
• Discovery of a Cosmological, Relativistic Outburst via its Rapidly Fading Optical Emission
• Type II supernova energetics and comparison of light curves to shock-cooling models
• Shock Breakout and Early Light Curves of Type II-P Supernovae Observed with Kepler
• Strong near-infrared carbon in the Type Ia supernova iPTF13ebh
• The rise and fall of the Type Ib supernova iPTF13bvn - Not a massive Wolf-Rayet star
• iPTF14yb: The First Discovery of a GRB Afterglow Independent of a High-Energy Trigger
• The Palomar Transient Factory photometric catalog 1.0
• iPTF13beo: The Double-Peaked Light Curve of a Type Ibn Supernova Discovered Shortly after Explosion

Cited by in corpus (45)

• Illuminating Gravitational Waves: A Concordant Picture of Photons from a Neutron Star Merger
• iPTF16geu: A multiply imaged, gravitationally lensed type Ia supernova
• iPTF16fnl: a faint and fast tidal disruption event in an E+A galaxy
• Energetic eruptions leading to a peculiar hydrogen-rich explosion of a massive star
• Light curves of hydrogen-poor Superluminous Supernovae from the Palomar Transient Factory
• iPTF Discovery of the Rapid "Turn On" of a Luminous Quasar
• A hot and fast ultra-stripped supernova that likely formed a compact neutron star binary
• Kilonova Luminosity Function Constraints based on Zwicky Transient Facility Searches for 13 Neutron Star Mergers
• The IPAC Image Subtraction and Discovery Pipeline for the intermediate Palomar Transient Factory
• Type IIn supernova light-curve properties measured from an untargeted survey sample
• iPTF16asu: A Luminous, Rapidly-Evolving, and High-Velocity Supernova
• The SPIRITS sample of Luminous Infrared Transients: Uncovering Hidden Supernovae and Dusty Stellar Outbursts in Nearby Galaxies
• Image Subtraction in Fourier Space
• Sifting for Sapphires: Systematic Selection of Tidal Disruption Events in iPTF
• iPTF 16hgs: A double-peaked Ca-rich gap transient in a metal poor, star forming dwarf galaxy
• Oxygen and helium in stripped-envelope supernovae
• Discovery of an intermediate-luminosity red transient in M51 and its likely dust-obscured, infrared-variable progenitor
• Color Me Intrigued: the Discovery of iPTF 16fnm, a Supernova 2002cx-like Object
• iPTF17cw: An engine-driven supernova candidate discovered independent of a gamma-ray trigger
• iPTF Archival Search for Fast Optical Transients
• SN2002es-like Supernovae From Different Viewing Angles
• Real-Time Recovery Efficiencies and Performance of the Palomar Transient Factory's Transient Discovery Pipeline
• Broad-lined type Ic supernova iPTF16asu: A challenge to all popular models
• A Machine Learning Classifier for Microlensing in Wide-Field Surveys
• Mergers of black hole-neutron star binaries and rates of associated electromagnetic counterparts
• Optical Transient Object Classification in Wide Field Small Aperture Telescopes with Neural Networks
• Preparing for advanced LIGO: A Star-Galaxy Separation Catalog for the Palomar Transient Factory
• Mary, a pipeline to aid discovery of optical transients
• Spectral Energy Distributions of Candidate Periodically-Variable Quasars: Testing the Binary Black Hole Hypothesis
• The Palomar Transient Factory Sky2Night programme
• iPTF Survey for Cool Transients
• Machine Learning based search for Cataclysmic Variables within Gaia Science Alerts
• The Evryscope Fast Transient Engine: Real-Time Detection for Rapidly Evolving Transients
• iPTF 16asu Revisited: A Rapidly Evolving Superluminous Broad-Lined Ic Supernova?
• A systematic study of spiral density waves in the accretion discs of Cataclysmic Variables
• Life Beyond PTF
• Deep Co-Added Sky from Catalina Sky Survey Images
• Detections of simultaneous brightening of gamma-ray and optical emissions of a distant blazar GB 1508+5714 at redshift 4.3
• TUVOpipe: a pipeline to search for UV transients with Swift-UVOT
• Towards Rate Estimation for Transient Surveys I: Assessing Transient Detectability and Volume Sensitivity for iPTF
• Machine Learning applications for Cataclysmic Variable discovery in the ZTF alert stream
• Hubble Space Telescope Imaging of Luminous Extragalactic Infrared Transients and Variables from the SPIRITS Survey
• AT 2016dah and AT 2017fyp: the first classical novae discovered within a tidal stream
• Optimizing Convolution Direction and Template Selection for Difference Image Analysis
• Finding Fast Transients in Real Time Using Novel Light Curve Analysis Algorithm