Radial-Velocity Fitting Challenge. II. First results of the analysis of the data set

Abstract

Radial-velocity (RV) signals induce RV variations an order of magnitude larger than the signal created by the orbit of Earth-twins, thus preventing their detection. The goal of this paper is to compare the efficiency of the different methods used to deal with stellar signals to recover extremely low-mass planets despite. However, because observed RV variations at the m/s precision level or below is a combination of signals induced by unresolved orbiting planets, by the star, and by the instrument, performing such a comparison using real data is extremely challenging. To circumvent this problem, we generated simulated RV measurements including realistic stellar and planetary signals. Different teams analyzed blindly those simulated RV measurements, using their own method to recover planetary signals despite stellar RV signals. By comparing the results obtained by the different teams with the planetary and stellar parameters used to generate the simulated RVs, it is therefore possible to compare the efficiency of these different methods. The most efficient methods to recover planetary signals {take into account the different activity indicators,} use red-noise models to account for stellar RV signals and a Bayesian framework to provide model comparison in a robust statistical approach. Using the most efficient methodology, planets can be found down to K/N= K_pl/RV_rms*sqrt{N_obs}=5 with a threshold of K/N=7.5 at the level of 80-90% recovery rate found for a number of methods. These recovery rates drop dramatically for K/N smaller than this threshold. In addition, for the best teams, no false positives with K/N > 7.5 were detected, while a non-negligible fraction of them appear for smaller K/N. A limit of K/N = 7.5 seems therefore a safe threshold to attest the veracity of planetary signals for RV measurements with similar properties to those of the different RV fitting challenge systems.

arXiv comment36 pages (including 10 pages of appendix), 23 figures, Accepted in A&A

References in corpus (59)

• emcee: The MCMC Hammer
• The generalised Lomb-Scargle periodogram. A new formalism for the floating-mean and Keplerian periodograms
• Improved Age Estimation for Solar-Type Dwarfs Using Activity-Rotation Diagnostics
• The PLATO 2.0 Mission
• No planet for HD 166435
• Transiting exoplanets from the CoRoT space mission VIII. CoRoT-7b: the first Super-Earth with measured radius
• The CORALIE survey for southern extra-solar planets VII. Two short-period Saturnian companions to HD108147 and HD168746
• Planets and Stellar Activity: Hide and Seek in the CoRoT-7 system
• Chromospheric Activity and Jitter Measurements for 2630 Stars on the California Planet Search
• Improving the Efficiency of Markov Chain Monte Carlo for Analyzing the Orbits of Extrasolar Planets
• The prevalence of dust on the exoplanet HD 189733b from Hubble and Spitzer observations
• A Gaussian process framework for modelling stellar activity signals in radial velocity data
• The HARPS search for southern extra-solar planets XVIII. An Earth-mass planet in the GJ 581 planetary system
• The HARPS-TERRA project I. Description of the algorithms, performance and new measurements on a few remarkable stars observed by HARPS
• Radial Velocity Jitter in Stars from the California and Carnegie Planet Search at Keck Observatory
• A simple method to estimate radial velocity variations due to stellar activity using photometry
• Stellar Activity Masquerading as Planets in the Habitable Zone of the M dwarf Gliese 581
• Using the Sun to estimate Earth-like planets detection capabilities II. Impact of plages
• Planetary detection limits taking into account stellar noise. I. Observational strategies to reduce stellar oscillation and granulation effects
• SOAP 2.0: A tool to estimate the photometric and radial velocity variations induced by stellar spots and plages
• Solar-like oscillations in alpha Centauri B
• Stellar activity of planetary host star HD 189733
• Efficient fitting of multiplanet Keplerian models to radial velocity and astrometry data
• The Lick-Carnegie Exoplanet Survey: A 3.1 M_Earth Planet in the Habitable Zone of the Nearby M3V Star Gliese 581
• The Sun as a planet-host star: Proxies from SDO images for HARPS radial-velocity variations
• A planetary system around the nearby M dwarf GJ 667C with at least one super-Earth in its habitable zone
• Bayesian search for low-mass planets around nearby M dwarfs. Estimates for occurrence rate based on global detectability statistics
• Ghost in the time series: no planet for Alpha Cen B
• The Kepler-10 planetary system revisited by HARPS-N: A hot rocky world and a solid Neptune-mass planet
• The fundamental definition of 'radial velocity'
• Determining the Mass of Kepler-78b With Nonparametric Gaussian Process Estimation
• A multi-site campaign to measure solar-like oscillations in Procyon. I. Observations, Data Reduction and Slow Variations
• SOAP. A tool for the fast computation of photometry and radial velocity induced by stellar spots
• The HARPS search for southern extra-solar planets. XXXVIII. Bayesian re-analysis of three systems. New super-Earths, unconfirmed signals, and magnetic cycles
• The impact of red noise in radial velocity planet searches: Only three planets orbiting GJ581?
• Habitable-zone super-Earth candidate in a six-planet system around the K2.5V star HD 40307
• The HARPS search for southern extra-solar planets XXXV. The interesting case of HD41248: stellar activity, no planets?
• The HARPS search for southern extra-solar planets. XXX. Planetary systems around stars with solar-like magnetic cycles and short-term activity variation
• HARPS-N observes the Sun as a star
• An Investigation into the Radial Velocity Variations of CoRoT-7
• Uncovering the planets and stellar activity of CoRoT-7 using only radial velocities
• On the use of marginal posteriors in marginal likelihood estimation via importance-sampling
• Bayesian Re-analysis of the Gliese 581 Exoplanet System
• Bayesian analysis of radial velocity data of GJ667C with correlated noise: evidence for only 2 planets
• Radial Velocity Data Analysis with Compressed Sensing Techniques
• Using the Sun to estimate Earth-like planets detection capabilities. V. Parameterizing the impact of solar activity components on radial velocities
• A Bayesian Periodogram Finds Evidence for Three Planets in 47 Ursae Majoris
• Radial Velocity Fitting Challenge. I. Simulating the data set including realistic stellar radial-velocity signals
• Comment on "Stellar activity masquerading as planets in the habitable zone of the M dwarf Gliese 581"
• Long-term radial-velocity variations of the Sun as a star: The HARPS view
• The Impact of Stellar Oscillations on Doppler Velocity Planet Searches
• Stellar Activity and its Implications for Exoplanet Detection on GJ 176
• Variability of surface flows on the Sun and the implications for exoplanet detection
• GJ 581 update: Additional Evidence for a Super-Earth in the Habitable Zone
• An investigation into the radial velocity variability of GJ 581 - On the significance of GJ 581g
• Periodic Halpha variations in GL 581: Further evidence for an activity origin to GL 581d
• An Apodized Kepler Periodogram for Separating Planetary and Stellar Activity Signals
• Probabilities of exoplanet signals from posterior samplings
• Stellar noise and planet detection. II. Radial-velocity noise induced by magnetic cycles

Cited by in corpus (83)

• A Kepler Study of Starspot Lifetimes with Respect to Light Curve Amplitude and Spectral Type
• Three years of Sun-as-a-star radial-velocity observations on the approach to solar minimum
• An Earth-sized exoplanet with a Mercury-like composition
• Measuring precise radial velocities on individual spectral lines : II. Dependance of stellar activity signal on line depth
• Warm terrestrial planet with half the mass of Venus transiting a nearby star
• Stacked Bayesian general Lomb-Scargle periodogram: Identifying stellar activity signals
• Color difference makes a difference: four planet candidates around tau Ceti
• Transit detection of the long-period volatile-rich super-Earth ${\nu }^2$ Lupi d with $CHEOPS$
• SPIRou Input Catalog: Activity, Rotation and Magnetic Field of Cool Dwarfs
• The HARPS search for southern extra-solar planets. XXXVI. Eight HARPS multi-planet systems hosting 20 super-Earth and Neptune-mass companions
• The HARPS search for southern extra-solar planets XLII. A system of Earth-mass planets around the nearby M dwarf YZ Ceti
• On the Feasibility of Intense Radial Velocity Surveys for Earth-twin Discoveries
• Quantifying the Bayesian Evidence for a Planet in Radial Velocity Data
• The EXPRES Stellar Signals Project II. State of the Field in Disentangling Photospheric Velocities
• Insights on the Spectral Signatures of Stellar Activity and Planets from PCA
• A pair of Sub-Neptunes transiting the bright K-dwarf TOI-1064 characterised with CHEOPS
• Bias and robustness of eccentricity estimates from radial velocity data
• Agatha: disentangling periodic signals from correlated noise in a periodogram framework
• Hot, rocky and warm, puffy super-Earths orbiting TOI-402 (HD 15337)
• The CARMENES search for exoplanets around M dwarfs. A Neptune-mass planet traversing the habitable zone around HD 180617
• K2-111: an old system with two planets in near-resonance
• Toward Extremely Precise Radial Velocities: II. A Tool For Using Multivariate Gaussian Processes to Model Stellar Activity
• Statistical methods for exoplanet detection with radial velocities
• The Magellan-TESS Survey I: Survey Description and Mid-Survey Results
• Unexpectedly strong effect of supergranulation on the detectability of Earth twins orbiting Sun-like stars with radial velocities
• Eyes on K2-3: A system of three likely sub-Neptunes characterized with HARPS-N and HARPS
• The HADES RV Programme with HARPS-N@TNG VIII. Gl15A: A multiple wide planetary system sculpted by binary interaction
• Starspot occultations in infrared transit spectroscopy: the case of WASP-52b
• Stellar signal components seen in HARPS and HARPS-N solar radial velocities
• The GAPS Programme at TNG XXVII. Reassessment of a young planetary system with HARPS-N: is the hot Jupiter V830 Tau b really there?
• Predicting radial-velocity jitter induced by stellar oscillations based on Kepler data
• Detection Limits of Low-mass, Long-period Exoplanets Using Gaussian Processes Applied to HARPS-N Solar RVs
• Activity time series of old stars from late F to early K. I. Simulating radial velocity, astrometry, photometry, and chromospheric emission
• Auto-correlation functions of astrophysical processes, and their relation to Gaussian processes; Application to radial velocities of different starspot configurations
• Proxima Centauri reloaded: Unravelling the stellar noise in radial velocities
• Evidence for at least three planet candidates orbiting HD20794
• The GAPS Programme with HARPS-N at TNG XVII. Line profile indicators and kernel regression as diagnostics of radial-velocity variations due to stellar activity in solar-like stars
• Search for Nearby Earth Analogs. III. Detection of ten new planets, three planet candidates, and confirmation of three planets around eleven nearby M dwarfs
• Activity time series of old stars from late F to early K. II. Radial velocity jitter and exoplanet detectability
• Activity time series of old stars from late F to early K. IV. Limits of the correction of radial velocities using chromospheric emission
• Probing Dark Matter Using Precision Measurements of Stellar Accelerations
• Measuring precise radial velocities and cross-correlation function line-profile variations using a Skew Normal density
• The effects of granulation and supergranulation on Earth-mass planet detectability in the habitable zone around F6-K4 stars
• The spectral impact of magnetic activity on disk-integrated HARPS-N solar observations: exploring new activity indicators
• Relationship between Ca and H$\alpha$ chromospheric emission in F-G-K stars: indication of stellar filaments?
• EXPRES. III. Revealing the Stellar Activity Radial Velocity Signature of $\epsilon$ Eridani with Photometry and Interferometry
• 3D magneto-hydrodynamical simulations of stellar convective noise for improved exoplanet detection. I. Case of regularly sampled radial velocity observations
• HADES RV Programme with HARPS-N at TNG VI. GJ 3942 b behind dominant activity signals
• The HADES RV Programme with HARPS-N at TNG XI. GJ 685 b: a warm super-Earth around an active M dwarf
• $\text{GRASS}$: Distinguishing Planet-induced Doppler Signatures from Granulation with a Synthetic Spectra Generator
• Activity time series of old stars from late F to early K. V. Effect on exoplanet detectability with high-precision astrometry
• Predictions of planet detections with near infrared radial velocities in the up-coming SPIRou Legacy Survey-Planet Search
• Activity time series of old stars from late F to early K VI. Exoplanet mass characterisation and detectability in radial velocity
• A new estimation of astrometric exoplanet detection limits in the habitable zone around nearby stars
• Joint Modeling of Radial Velocities and Photometry with a Gaussian Process Framework
• Simulations for Planning Next-Generation Exoplanet Radial Velocity Surveys
• Biases in retrieving planetary signals in the presence of quasi-periodic stellar activity
• Another super-dense sub-Neptune in K2-182 b and refined mass measurements for K2-199 b and c
• A collage of small planets from the Lick Carnegie Exoplanet Survey : Exploring the super-Earth and sub-Neptune mass regime
• A likely magnetic activity cycle for the exoplanet host M dwarf GJ 3512
• Ross 128 -- GL 447A possible activity cycle for a slow-rotating fully-convective star
• The origin of the high-mass X-ray binary 4U 2206+54/BD +53 2790
• EXPRES. II. Searching for Planets Around Active Stars: A Case Study of HD 101501
• Sectoral r modes and periodic RV variations of Sun-like stars
• Diving into the planetary system of Proxima with NIRPS -- Breaking the metre per second barrier in the infrared
• Periodic stellar variability from almost a million NGTS light curves
• Accounting for stellar activity signals in radial-velocity data by using Change Point Detection techniques
• Solar Photospheric Spectrum Microvariability I. Theoretical searches for proxies of radial-velocity jittering
• Searching for planetary signals in Doppler time series: a performance evaluation of tools for periodograms analysis
• Data challenges as a tool for time-domain astronomy
• A Stellar Activity F-statistic for Exoplanet Surveys (SAFE)
• A Bayesian inference and model selection algorithm with an optimisation scheme to infer the model noise power
• KOBE-1: The first planetary system from the KOBE survey. Two planets likely residing in the sub-Neptune mass regime around a late K-dwarf
• Precise radial velocities of giant stars XV. Mysterious nearly periodic radial velocity variations in the eccentric binary $\epsilon$ Cygni
• Nonparametric Methods in Astronomy: Think, Regress, Observe -- Pick Any Three
• HADES RV programme with HARPS-N at TNG XIV. A candidate super-Earth orbiting the M-dwarf GJ 9689 with a period close to half the stellar rotation period
• Future Exoplanet Research: Science Questions and How to Address Them
• gaspery: Optimized Scheduling of Radial Velocity Follow-Up Observations for Active Host Stars
• Radial velocity precision of ESPRESSO through the analysis of the solar twin HIP 11915
• The CARMENES search for exoplanets around M dwarfs : Understanding the wavelength dependence of radial velocity measurements
• Stacked Periodograms as a Probe of Exoplanetary Populations
• Measuring masses of transiting Earth-like planets: first insights from the PLATO RV data challenge
• Spectral Ratio Analysis: probing of a new suite of stellar activity indicators as a tool for astrophysical noise mitigation