De-Trending Time Series for Astronomical Variability Surveys

Abstract

We present a de-trending algorithm for the removal of trends in time series. Trends in time series could be caused by various systematic and random noise sources such as cloud passages, changes of airmass, telescope vibration or CCD noise. Those trends undermine the intrinsic signals of stars and should be removed. We determine the trends from subsets of stars that are highly correlated among themselves. These subsets are selected based on a hierarchical tree clustering algorithm. A bottom-up merging algorithm based on the departure from normal distribution in the correlation is developed to identify subsets, which we call clusters. After identification of clusters, we determine a trend per cluster by weighted sum of normalized light-curves. We then use quadratic programming to de-trend all individual light-curves based on these determined trends. Experimental results with synthetic light-curves containing artificial trends and events are presented. Results from other de-trending methods are also compared. The developed algorithm can be applied to time series for trend removal in both narrow and wide field astronomy.

Revised version according to the referee's second review

References in corpus (15)

• Analytic Lightcurves for Planetary Transit Searches
• The USNO-B Catalog
• Wide-field millimagnitude photometry with HAT: A Tool for Extra-solar Planet Detection
• Correcting systematic effects in a large set of photometric lightcurves
• TrES-1: The Transiting Planet of a Bright K0V Star
• A Trend Filtering Algorithm for wide field variability surveys
• HAT-P-1b: A Large-Radius, Low-Density Exoplanet Transiting one Member of a Stellar Binary
• WASP-3b: a strongly-irradiated transiting gas-giant planet
• ROTSE All Sky Surveys for Variable Stars I: Test Fields
• HAT-P-7b: An Extremely Hot Massive Planet Transiting a Bright Star in the Kepler Field
• The XO Project: Searching for Transiting Extra-solar Planet Candidates
• XO-5b: A Transiting Jupiter-sized Planet With A Four Day Period
• The Taiwanese-American Occultation Survey: The Multi-Telescope Robotic Observatory
• First Results From The Taiwanese-American Occultation Survey (TAOS)
• Beta Cephei stars in the ASAS-3 data. I. Long-term variations of periods and amplitudes

Cited by in corpus (22)

• Wotan: Comprehensive time-series de-trending in Python
• Transit Detection in the MEarth Survey of Nearby M Dwarfs: Bridging the Clean-First, Search-Later Divide
• Machine Learning Techniques for Stellar Light Curve Classification
• Clustering Based Feature Learning on Variable Stars
• Unsupervised Classification of Variable Stars
• Searching for sub-kilometer TNOs using Pan-STARRS video mode lightcurves: Preliminary study and evaluation using engineering data
• Tools for discovering and characterizing extrasolar planets
• Uncertain classification of Variable Stars: handling observational GAPS and noise
• Exoplanets in the Antarctic sky. II. 116 Transiting Exoplanet Candidates Found by AST3-II (CHESPA) within the Southern CVZ of TESS
• The effect of phased recurrent units in the classification of multiple catalogs of astronomical lightcurves
• Streaming Classification of Variable Stars
• YOUNG Star detrending for Transiting Exoplanet Recovery (YOUNGSTER) -- I. A search for young exoplanets in Sectors 1-5 of the TESS Full-Frame-Images
• Periodic transit and variability search with simultaneous systematics filtering: Is it worth it?
• A modified CoRoT detrend algorithm and the discovery of a new planetary companion
• The Hubble Catalog of Variables (HCV)
• The TAOS Project Stellar Variability I. Detection of Low-Amplitude delta Scuti Stars
• TFAW: wavelet-based signal reconstruction to reduce photometric noise in time-domain surveys
• A New Method For Robust High-Precision Time-Series Photometry From Well-Sampled Images: Application to Archival MMT/Megacam Observations of the Open Cluster M37
• Finding radio transients with anomaly detection and active learning based on volunteer classifications
• A Catalogue of Locus Algorithm Pointings for Optimal Differential Photometry for 23,779 Quasars
• Application of the Trend Filtering Algorithm for Photometric Time Series Data
• First systematic high-precision survey of bright supernovae I. Methodology for identifying early bumps