The IPAC Image Subtraction and Discovery Pipeline for the intermediate Palomar Transient Factory
arXiv:1608.01733 · doi:10.1088/1538-3873/129/971/014002
Abstract
We describe the near real-time transient-source discovery engine for the intermediate Palomar Transient Factory (iPTF), currently in operations at the Infrared Processing and Analysis Center (IPAC), Caltech. We coin this system the IPAC/iPTF Discovery Engine (or IDE). We review the algorithms used for PSF-matching, image subtraction, detection, photometry, and machine-learned (ML) vetting of extracted transient candidates. We also review the performance of our ML classifier. For a limiting signal-to-noise ratio of 4 in relatively unconfused regions, "bogus" candidates from processing artifacts and imperfect image subtractions outnumber real transients by ~ 10:1. This can be considerably higher for image data with inaccurate astrometric and/or PSF-matching solutions. Despite this occasionally high contamination rate, the ML classifier is able to identify real transients with an efficiency (or completeness) of ~ 97% for a maximum tolerable false-positive rate of 1% when classifying raw candidates. All subtraction-image metrics, source features, ML probability-based real-bogus scores, contextual metadata from other surveys, and possible associations with known Solar System objects are stored in a relational database for retrieval by the various science working groups. We review our efforts in mitigating false-positives and our experience in optimizing the overall system in response to the multitude of science projects underway with iPTF.
66 pages, 21 figures, 7 tables, accepted by PASP
References in corpus (12)
- The Sloan Digital Sky Survey-II Supernova Survey: Search Algorithm and Follow-up Observations
- A New Algorithm For Difference Image Analysis
- The Sloan Digital Sky Survey Stripe 82 Imaging Data: Depth-Optimized Co-adds Over 300 Deg^2 in Five Filters
- Exploring the spectral diversity of low-redshift Type Ia supernovae using the Palomar Transient Factory
- Slow-Speed Supernovae from the Palomar Transient Factory: Two Channels
- Machine learning for transient discovery in Pan-STARRS1 difference imaging
- The Needle in the 100 deg2 Haystack: Uncovering Afterglows of Fermi GRBs with the Palomar Transient Factory
- Intermediate Palomar Transient Factory: Realtime Image Subtraction Pipeline
- Astronomical Image Subtraction by Cross-Convolution
- OGLE-IV Real-Time Transient Search
- Optimising Optimal Image Subtraction
- Reference image selection for difference imaging analysis
Cited by in corpus (23)
- The Zwicky Transient Facility: System Overview, Performance, and First Results
- The Zwicky Transient Facility: Data Processing, Products, and Archive
- The Zwicky Transient Facility: Science Objectives
- Illuminating Gravitational Waves: A Concordant Picture of Photons from a Neutron Star Merger
- Two New Calcium-Rich Gap Transients in Group and Cluster Environments
- iPTF16asu: A Luminous, Rapidly-Evolving, and High-Velocity Supernova
- An extremely energetic supernova from a very massive star in a dense medium
- A transient search using combined human and machine classifications
- PTF11mnb: the first analog of supernova 2005bf
- Small near-Earth asteroids in the Palomar Transient Factory survey: A real-time streak-detection system
- iPTF17cw: An engine-driven supernova candidate discovered independent of a gamma-ray trigger
- Optical Transient Object Classification in Wide Field Small Aperture Telescopes with Neural Networks
- PTF 14jg: The Remarkable Outburst and Post-Burst Evolution of a Previously Anonymous Galactic Star
- Preparing for advanced LIGO: A Star-Galaxy Separation Catalog for the Palomar Transient Factory
- A population of Type Ibc supernovae with massive progenitors; broad lightcurves not uncommon in (i)PTF
- SN 2019zrk, a bright SN 2009ip analog with a precursor
- The radial distribution of supernovae compared to star formation tracers
- A novel method for transient detection in high-cadence optical surveys: Its application for a systematic search for novae in M31
- Long-term Periodicities of Cataclysmic Variables with Synoptic Surveys
- A search for intermediate-mass black holes in compact stellar systems through optical emissions from tidal disruption events
- Differencing and Coadding JWST Images with Matched Point Spread Function
- Hubble Space Telescope Imaging of Luminous Extragalactic Infrared Transients and Variables from the SPIRITS Survey
- AT 2016dah and AT 2017fyp: the first classical novae discovered within a tidal stream