The SATCHEL pipeline: A general tool for data classified through citizen science

Abstract

Citizen science is a powerful analysis tool, capable of processing large amounts of data in a very short time. To bridge the gap between classification data products from web-based citizen science platforms to statistically robust signal significance scores, we present the Search Algorithm for Transits in the Citizen science Hunt for Exoplanets in Lightcurves (SATCHEL) pipeline. This open source, customizable pipeline was constructed to identify and assign significance estimates to one-dimensional features marked by volunteers. We describe the functional capabilities of the SATCHEL pipeline through application to features in photometric time-series data from the Kepler Space Telescope, classified by volunteers as part of the Planet Hunters citizen science project hosted on the Zooniverse platform. We evaluate the SATCHEL pipeline's overall performance based on recovery of known signals (both simulations and signals corresponding to official Kepler Objects of Interest) and relative contamination by spurious features. We find that, for a range of pipeline hyperparameters and with a reasonable score cutoff, SATCHEL is able to recover volunteer identifications of over 98% of signals from simulations corresponding to exoplanets $>2R_{\oplus }$ in radius and about 85% of signals corresponding to the same size range of KOIs. SATCHEL is transparently adaptable to other citizen science classification datasets, and available on GitHub.

arXiv comment20 pages, 23 figures. Accepted for publication in MNRAS

References in corpus (40)

• The NumPy array: a structure for efficient numerical computation
• The Transiting Exoplanet Survey Satellite
• Galaxy Zoo : Morphologies derived from visual inspection of galaxies from the Sloan Digital Sky Survey
• Kepler Mission Design, Realized Photometric Performance, and Early Science
• The false positive rate of Kepler and the occurrence of planets
• Kepler Presearch Data Conditioning I - Architecture and Algorithms for Error Correction in Kepler Light Curves
• Galaxy Zoo 2: detailed morphological classifications for 304,122 galaxies from the Sloan Digital Sky Survey
• Overview of the Kepler Science Processing Pipeline
• The Occurrence and Mass Distribution of Close-in Super-Earths, Neptunes, and Jupiters
• Terrestrial Planet Occurrence Rates for the Kepler GK Dwarf Sample
• Galaxy Zoo : 'Hanny's Voorwerp', a quasar light echo?
• Planet Hunters X. KIC 8462852 - Where's the Flux?
• The Derivation, Properties and Value of Kepler's Combined Differential Photometric Precision
• Rotation periods of 12 000 main-sequence Kepler stars: Dependence on stellar spectral type and comparison with v sin i observations
• The Milky Way Project First Data Release: A Bubblier Galactic Disk
• They are Small Worlds After All: Revised Properties of Kepler M Dwarf Stars and their Planets
• Kepler Planet Occurrence Rates for Mid-Type M Dwarfs as a Function of Spectral Type
• Planet Hunters: The First Two Planet Candidates Identified by the Public using the Kepler Public Archive Data
• Space Warps: I. Crowd-sourcing the Discovery of Gravitational Lenses
• Galaxy Zoo: Quantitative Visual Morphological Classifications for 48,000 galaxies from CANDELS
• The population of long-period transiting exoplanets
• A Probabilistic Approach to Kepler Completeness and Reliability for Exoplanet Occurrence Rates
• PHAT Stellar Cluster Survey. II. Andromeda Project Cluster Catalog
• The K2-138 System: A Near-Resonant Chain of Five Sub-Neptune Planets Discovered by Citizen Scientists
• Planet Hunters. VIII. Characterization of 41 Long-Period Exoplanet Candidates from Kepler Archival Data
• Single Transit Candidates from K2: Detection and Period Estimation
• Planet Hunters TESS I: TOI 813, a subgiant hosting a transiting Saturn-sized planet on an 84-day orbit
• Planet Hunters. VI: An Independent Characterization of KOI-351 and Several Long Period Planet Candidates from the Kepler Archival Data
• Planet Hunters. V. A Confirmed Jupiter-Size Planet in the Habitable Zone and 42 Planet Candidates from the Kepler Archive Data
• Planet Hunters: Assessing the Kepler Inventory of Short Period Planets
• Observational biases for transiting planets
• Planet Hunters TESS II: Findings from the first two years of TESS
• Transiting Planet Candidates Beyond the Snow Line Detected by Visual Inspection of 7557 Kepler Objects of Interest
• Characterizing Long-Period Transiting Planets Observed by Kepler
• Revisiting the Long-Period Transiting Planets from Kepler
• Disk Detective: Discovery of New Circumstellar Disk Candidates through Citizen Science
• M Dwarf Exoplanet Surface Density Distribution: A Log-Normal Fit from 0.07-400 AU
• Reliability Correction is Key for Robust Kepler Occurrence Rates
• Catalog of New K2 Exoplanet Candidates from Citizen Scientists
• Single Transits and Eclipses Observed by K2