Improving exoplanet detection capabilities with the false inclusion probability. Comparison with other detection criteria in the context of radial velocities

Abstract

Context. In exoplanet searches with radial velocity data, the most common statistical significance metrics are the Bayes factor and the false alarm probability (FAP). Both have proved useful, but do not directly address whether an exoplanet detection should be claimed. Furthermore, it is unclear which detection threshold should be taken and how robust the detections are to model misspecification. Aims. The present work aims at defining a detection criterion which conveys as precisely as possible the information needed to claim an exoplanet detection. We compare this new criterion to existing ones in terms of sensitivity and robustness. Methods. We define a significance metric called the false inclusion probability (FIP) based on the posterior probability of presence of a planet. Posterior distributions are computed with the nested sampling package Polychord. We show that for FIP and Bayes factor calculations, defining priors on linear parameters as Gaussian mixture models allows to significantly speed up computations. The performances of the FAP, Bayes factor and FIP are studied with simulations as well as analytical arguments. We compare the methods assuming the model is correct, then evaluate their sensitivity to the prior and likelihood choices. Results. Among other properties, the FIP offers ways to test the reliability of the significance levels, it is particularly efficient to account for aliasing and allows to exclude the presence of planets with a certain confidence. We find that, in our simulations, the FIP outperforms existing detection metrics. We show that planet detections are sensitive to priors on period and semi-amplitude and that letting free the noise parameters offers better performances than fixing a noise model based on a fit to ancillary indicators.

arXiv commentAccepted for publication in Astronomy & Astrophysics

References in corpus (60)

• The generalised Lomb-Scargle periodogram. A new formalism for the floating-mean and Keplerian periodograms
• The California-Kepler Survey. III. A Gap in the Radius Distribution of Small Planets
• Optimal predictive model selection
• No planet for HD 166435
• Planets and Stellar Activity: Hide and Seek in the CoRoT-7 system
• PolyChord: nested sampling for cosmology
• PolyChord: next-generation nested sampling
• Improving the Efficiency of Markov Chain Monte Carlo for Analyzing the Orbits of Extrasolar Planets
• Quantifying the Uncertainty in the Orbits of Extrasolar Planets
• A Gaussian process framework for modelling stellar activity signals in radial velocity data
• Assessing statistical significance of periodogram peaks
• An extrasolar planetary system with three Neptune-mass planets
• The Lick Planet Search: Detectability and Mass Thresholds
• Radial velocity planets de-aliased. A new, short period for Super-Earth 55 Cnc e
• Using the Sun to estimate Earth-like planets detection capabilities II. Impact of plages
• Planetary detection limits taking into account stellar noise. I. Observational strategies to reduce stellar oscillation and granulation effects
• SOAP 2.0: A tool to estimate the photometric and radial velocity variations induced by stellar spots and plages
• Detectability of Extrasolar Planets in Radial Velocity Surveys
• Stellar activity of planetary host star HD 189733
• Inferring the eccentricity distribution
• Efficient fitting of multiplanet Keplerian models to radial velocity and astrometry data
• Six transiting planets and a chain of Laplace resonances in TOI-178
• The Sun as a planet-host star: Proxies from SDO images for HARPS radial-velocity variations
• SigSpec - I. Frequency- and Phase-Resolved Significance in Fourier Space
• Three years of Sun-as-a-star radial-velocity observations on the approach to solar minimum
• BGLS: A Bayesian formalism for the generalised Lomb-Scargle periodogram
• The Joker: A custom Monte Carlo sampler for binary-star and exoplanet radial velocity data
• Accounting for velocity jitter in planet search surveys
• Detecting extrasolar planets from stellar radial velocities using Bayesian evidence
• Uncovering the planets and stellar activity of CoRoT-7 using only radial velocities
• Stacked Bayesian general Lomb-Scargle periodogram: Identifying stellar activity signals
• A Bayesian Kepler Periodogram detects a second planet in HD 208487
• Evidence for 9 planets in the HD 10180 system
• Selection Functions in Doppler Planet Searches
• Radial Velocity Data Analysis with Compressed Sensing Techniques
• A Bayesian periodogram finds evidence for three planets in HD 11964
• Bayesian priors for the eccentricity of transiting planets
• The HARPS search for southern extra-solar planets. XXXVI. Eight HARPS multi-planet systems hosting 20 super-Earth and Neptune-mass companions
• Bayesian re-analysis of the radial velocities of Gliese 581. Evidence in favour of only four planetary companions
• Quantifying the Bayesian Evidence for a Planet in Radial Velocity Data
• A planetary system with gas giants and super-Earths around the nearby M dwarf GJ 676A. Optimizing data analysis techniques for the detection of multi-planetary systems
• Detecting multiple periodicities in observational data with the multi-frequency periodogram. I. Analytic assessment of the statistical significance
• Bias and robustness of eccentricity estimates from radial velocity data
• Fast Bayesian Inference for Exoplanet Discovery in Radial Velocity Data
• Agatha: disentangling periodic signals from correlated noise in a periodogram framework
• The SOPHIE search for northern extrasolar planets. XVI. HD 158259: A compact planetary system in a near-3:2 mean motion resonance chain
• Decoding the radial velocity variations of HD41248 with ESPRESSO
• Efficient modeling of correlated noise I. Statistical significance of periodogram peaks
• Detecting non-sinusoidal periodicities in observational data: the von Mises periodogram for variable stars and exoplanetary transits
• The SOPHIE search for northern extrasolar planets XIII. Two planets around M-dwarfs Gl617A and Gl96
• Testing whether a signal is strictly periodic. Application to disentangling planets and stellar activity in radial velocities
• The SOPHIE search for northern extrasolar planets XV. A Warm Neptune around the M-dwarf Gl378
• Keplerian periodogram for Doppler exoplanets detection: optimized computation and analytic significance thresholds
• An Apodized Kepler Periodogram for Separating Planetary and Stellar Activity Signals
• Detection of Periodicity Based on Independence Tests - III. Phase Distance Correlation Periodogram
• The Demographics of Wide-Separation Planets
• Detection of Periodicity Based on Serial Dependence of Phase-Folded Data
• Searching for planetary signals in Doppler time series: a performance evaluation of tools for periodograms analysis
• Detection of Periodicity Based on Independence Tests - II. Improved Serial Independence Measure
• Aliasing in the Radial Velocities of YZ Ceti: An Ultra-Short Period for YZ Ceti c?

Cited by in corpus (29)

• A candidate short-period sub-Earth orbiting Proxima Centauri
• DREAM I. Orbital architecture orrery
• Radial-velocity discovery of a second planet in the TOI-1338/BEBOP-1 circumbinary system
• Two temperate Earth-mass planets orbiting the nearby star GJ1002
• Efficient modeling of correlated noise. III. Scalable methods for jointly modeling several observables' time series with Gaussian processes
• Statistical methods for exoplanet detection with radial velocities
• Testing whether a signal is strictly periodic. Application to disentangling planets and stellar activity in radial velocities
• Sub-m s${}^{-1}$ upper limits from a deep HARPS-N radial-velocity search for planets orbiting HD 166620 and HD 144579
• A sub-Earth-mass planet orbiting Barnard's star
• The SOPHIE search for northern extrasolar planets-XIX. A system including a cold sub-Neptune potentially transiting a V = 6.5 star HD88986
• A full transit of ${\nu }^2$ Lupi d and the search for an exomoon in its Hill sphere with CHEOPS
• The HARPS search for southern extra-solar planets. XLVI: 12 super-Earths around the solar type stars HD39194, HD93385, HD96700, HD154088, and HD189567
• Activity time series of old stars from late F to early K VI. Exoplanet mass characterisation and detectability in radial velocity
• Revisiting the multi-planetary system of the nearby star HD 20794: Confirmation of a low-mass planet in the habitable zone of a nearby G-dwarf
• Radial velocity homogeneous analysis of M dwarfs observed with HARPS I. Exoplanet detection and candidates
• Diving into the planetary system of Proxima with NIRPS -- Breaking the metre per second barrier in the infrared
• Characterization of the HD 108236 system with CHEOPS and TESS. Confirmation of a fifth transiting planet
• A review of planetary systems around HD 99492, HD 147379 and HD 190007 with HARPS-N
• BEBOP VII. SOPHIE discovery of BEBOP-3b, a circumbinary giant planet on an eccentric orbit
• In-depth characterization of the Kepler-10 three-planet system with HARPS-N radial velocities and Kepler transit timing variations
• Gl 725A b: a potential super-Earth detected with SOPHIE and SPIRou in an M dwarf binary system at 3.5 pc
• A continuous multiple hypothesis testing framework for optimal exoplanet detection
• HADES RV Programme with HARPS-N at TNG. XVI. A super-Earth in the habitable zone of the GJ 3998 multi-planet system
• The SPIRou Legacy Survey: Detection of a nearby world orbiting in the habitable zone of Gl725B achieved by correcting strong telluric contamination in near-infrared radial velocities with WAPITI
• Stellar-activity analysis of the nearby M dwarf GJ 526. Multi-dimensional Gaussian-process modelling of RV, FWHM and S-index
• GJ 9404 b: a confirmed eccentric planet, and not a candidate
• Gas-depleted planet formation occurred in the four-planet system around the red dwarf LHS 1903
• An Independent Search for Small Long-period Planets in Kepler Data I: Detection Pipeline
• The RoPES project with HARPS and HARPS-N II. A third planet in the multi-planet system HD 176986