Radial-Velocity Fitting Challenge. II. First results of the analysis of the data set

Abstract

Radial-velocity (RV) signals induce RV variations an order of magnitude larger than the signal created by the orbit of Earth-twins, thus preventing their detection. The goal of this paper is to compare the efficiency of the different methods used to deal with stellar signals to recover extremely low-mass planets despite. However, because observed RV variations at the m/s precision level or below is a combination of signals induced by unresolved orbiting planets, by the star, and by the instrument, performing such a comparison using real data is extremely challenging. To circumvent this problem, we generated simulated RV measurements including realistic stellar and planetary signals. Different teams analyzed blindly those simulated RV measurements, using their own method to recover planetary signals despite stellar RV signals. By comparing the results obtained by the different teams with the planetary and stellar parameters used to generate the simulated RVs, it is therefore possible to compare the efficiency of these different methods. The most efficient methods to recover planetary signals {take into account the different activity indicators,} use red-noise models to account for stellar RV signals and a Bayesian framework to provide model comparison in a robust statistical approach. Using the most efficient methodology, planets can be found down to K/N= K_pl/RV_rms*sqrt{N_obs}=5 with a threshold of K/N=7.5 at the level of 80-90% recovery rate found for a number of methods. These recovery rates drop dramatically for K/N smaller than this threshold. In addition, for the best teams, no false positives with K/N > 7.5 were detected, while a non-negligible fraction of them appear for smaller K/N. A limit of K/N = 7.5 seems therefore a safe threshold to attest the veracity of planetary signals for RV measurements with similar properties to those of the different RV fitting challenge systems.

36 pages (including 10 pages of appendix), 23 figures, Accepted in A&A

References in corpus (17)

• The generalised Lomb-Scargle periodogram. A new formalism for the floating-mean and Keplerian periodograms
• Improved Age Estimation for Solar-Type Dwarfs Using Activity-Rotation Diagnostics
• Planets and Stellar Activity: Hide and Seek in the CoRoT-7 system
• Stellar Activity Masquerading as Planets in the Habitable Zone of the M dwarf Gliese 581
• SOAP 2.0: A tool to estimate the photometric and radial velocity variations induced by stellar spots and plages
• Stellar activity of planetary host star HD 189733
• Efficient fitting of multiplanet Keplerian models to radial velocity and astrometry data
• Bayesian search for low-mass planets around nearby M dwarfs. Estimates for occurrence rate based on global detectability statistics
• The Kepler-10 planetary system revisited by HARPS-N: A hot rocky world and a solid Neptune-mass planet
• A multi-site campaign to measure solar-like oscillations in Procyon. I. Observations, Data Reduction and Slow Variations
• The impact of red noise in radial velocity planet searches: Only three planets orbiting GJ581?
• The HARPS search for southern extra-solar planets XXXV. The interesting case of HD41248: stellar activity, no planets?
• Radial Velocity Data Analysis with Compressed Sensing Techniques
• Radial Velocity Fitting Challenge. I. Simulating the data set including realistic stellar radial-velocity signals
• Comment on "Stellar activity masquerading as planets in the habitable zone of the M dwarf Gliese 581"
• The Impact of Stellar Oscillations on Doppler Velocity Planet Searches
• Stellar Activity and its Implications for Exoplanet Detection on GJ 176

Cited by in corpus (58)

• A Kepler Study of Starspot Lifetimes with Respect to Light Curve Amplitude and Spectral Type
• Three years of Sun-as-a-star radial-velocity observations on the approach to solar minimum
• Measuring precise radial velocities on individual spectral lines : II. Dependance of stellar activity signal on line depth
• Warm terrestrial planet with half the mass of Venus transiting a nearby star
• Color difference makes a difference: four planet candidates around tau Ceti
• Transit detection of the long-period volatile-rich super-Earth ${\nu }^2$ Lupi d with $CHEOPS$
• SPIRou Input Catalog: Activity, Rotation and Magnetic Field of Cool Dwarfs
• The HARPS search for southern extra-solar planets XLII. A system of Earth-mass planets around the nearby M dwarf YZ Ceti
• The EXPRES Stellar Signals Project II. State of the Field in Disentangling Photospheric Velocities
• Insights on the Spectral Signatures of Stellar Activity and Planets from PCA
• A pair of Sub-Neptunes transiting the bright K-dwarf TOI-1064 characterised with CHEOPS
• Bias and robustness of eccentricity estimates from radial velocity data
• Hot, rocky and warm, puffy super-Earths orbiting TOI-402 (HD 15337)
• K2-111: an old system with two planets in near-resonance
• Toward Extremely Precise Radial Velocities: II. A Tool For Using Multivariate Gaussian Processes to Model Stellar Activity
• Statistical methods for exoplanet detection with radial velocities
• Unexpectedly strong effect of supergranulation on the detectability of Earth twins orbiting Sun-like stars with radial velocities
• The Magellan-TESS Survey I: Survey Description and Mid-Survey Results
• Stellar signal components seen in HARPS and HARPS-N solar radial velocities
• The GAPS Programme at TNG XXVII. Reassessment of a young planetary system with HARPS-N: is the hot Jupiter V830 Tau b really there?
• Detection Limits of Low-mass, Long-period Exoplanets Using Gaussian Processes Applied to HARPS-N Solar RVs
• Activity time series of old stars from late F to early K. I. Simulating radial velocity, astrometry, photometry, and chromospheric emission
• Proxima Centauri reloaded: Unravelling the stellar noise in radial velocities
• Auto-correlation functions of astrophysical processes, and their relation to Gaussian processes; Application to radial velocities of different starspot configurations
• Evidence for at least three planet candidates orbiting HD20794
• Search for Nearby Earth Analogs. III. Detection of ten new planets, three planet candidates, and confirmation of three planets around eleven nearby M dwarfs
• Activity time series of old stars from late F to early K. IV. Limits of the correction of radial velocities using chromospheric emission
• The effects of granulation and supergranulation on Earth-mass planet detectability in the habitable zone around F6-K4 stars
• Relationship between Ca and H$\alpha$ chromospheric emission in F-G-K stars: indication of stellar filaments?
• The spectral impact of magnetic activity on disk-integrated HARPS-N solar observations: exploring new activity indicators
• EXPRES. III. Revealing the Stellar Activity Radial Velocity Signature of $\epsilon$ Eridani with Photometry and Interferometry
• $\text{GRASS}$: Distinguishing Planet-induced Doppler Signatures from Granulation with a Synthetic Spectra Generator
• Activity time series of old stars from late F to early K. V. Effect on exoplanet detectability with high-precision astrometry
• Simulations for Planning Next-Generation Exoplanet Radial Velocity Surveys
• A new estimation of astrometric exoplanet detection limits in the habitable zone around nearby stars
• Joint Modeling of Radial Velocities and Photometry with a Gaussian Process Framework
• Activity time series of old stars from late F to early K VI. Exoplanet mass characterisation and detectability in radial velocity
• Another super-dense sub-Neptune in K2-182 b and refined mass measurements for K2-199 b and c
• A collage of small planets from the Lick Carnegie Exoplanet Survey : Exploring the super-Earth and sub-Neptune mass regime
• The origin of the high-mass X-ray binary 4U 2206+54/BD +53 2790
• A likely magnetic activity cycle for the exoplanet host M dwarf GJ 3512
• Sectoral r modes and periodic RV variations of Sun-like stars
• EXPRES. II. Searching for Planets Around Active Stars: A Case Study of HD 101501
• Diving into the planetary system of Proxima with NIRPS -- Breaking the metre per second barrier in the infrared
• Periodic stellar variability from almost a million NGTS light curves
• Accounting for stellar activity signals in radial-velocity data by using Change Point Detection techniques
• Solar Photospheric Spectrum Microvariability I. Theoretical searches for proxies of radial-velocity jittering
• A Stellar Activity F-statistic for Exoplanet Surveys (SAFE)
• Nonparametric Methods in Astronomy: Think, Regress, Observe -- Pick Any Three
• Precise radial velocities of giant stars XV. Mysterious nearly periodic radial velocity variations in the eccentric binary $\epsilon$ Cygni
• KOBE-1: The first planetary system from the KOBE survey. Two planets likely residing in the sub-Neptune mass regime around a late K-dwarf
• A Bayesian inference and model selection algorithm with an optimisation scheme to infer the model noise power
• HADES RV programme with HARPS-N at TNG XIV. A candidate super-Earth orbiting the M-dwarf GJ 9689 with a period close to half the stellar rotation period
• The CARMENES search for exoplanets around M dwarfs : Understanding the wavelength dependence of radial velocity measurements
• gaspery: Optimized Scheduling of Radial Velocity Follow-Up Observations for Active Host Stars
• Radial velocity precision of ESPRESSO through the analysis of the solar twin HIP 11915
• Stacked Periodograms as a Probe of Exoplanetary Populations
• Spectral Ratio Analysis: probing of a new suite of stellar activity indicators as a tool for astrophysical noise mitigation