Knobs and dials of retrieving JWST transmission spectra. II. Impacts of pipeline-level differences on retrieval posteriors
arXiv:2511.05652 · doi:10.1051/0004-6361/202556553
Abstract
Since the launch of JWST, observations of exoplanetary atmospheres have seen a revolution in data quality. Given that atmospheric parameter inferences depend heavily on the underlying data, a re-evaluation of current methodologies is warranted to assess the reliability of these results. We investigate the impact of variations in input spectra on atmospheric retrievals for the hot Jupiter WASP-39 b using JWST transit data. Specifically, we analyse the reliability of parameter estimations from random perturbations of the underlying spectrum and their sensitivity to three transmission spectra derived from the same observational data. Using the NIRSpec PRISM observation from a single transit of WASP-39 b, we perform retrievals with the TauREx framework. As a baseline, we use a spectrum derived with the Eureka! data reduction pipeline. To evaluate retrieval reliability, we analyse posterior distributions under deviations from this spectrum. We simulate random noise by performing retrievals on scattered instances of this spectrum and compare them with retrievals based on existing spectra reduced from the same raw observation. Our analysis identifies three types of posterior distributions: (1) Stable, Gaussian distributions for species constrained across the entire spectrum (e.g., H2O, CO2); (2) Uniform posteriors with upper bounds for weakly constrained species (e.g., CO, CH4); and (3) Unstable, heavy-tailed posteriors for species constrained by minor spectrum features (e.g., SO2, C2H2). We find that other parameters, such as the planetary radius and p-T profile, are stable under spectral perturbations. Posterior distributions differ for retrievals on independently reduced transmission spectra from the same raw data, complicating interpretation, particularly for skewed distributions. Based on this, we advocate for careful assessment and selection of credible interval sizes to reflect this.
20 pages, 12 figures. Accepted for publication in Astronomy and Astrophysics
References in corpus (52)
- SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
- Array Programming with NumPy
- The Near-Infrared Spectrograph (NIRSpec) on the James Webb Space Telescope I. Overview of the instrument and its capabilities
- The James Webb Space Telescope Mission
- Early Release Science of the exoplanet WASP-39b with JWST NIRSpec PRISM
- Tau-REx I: A next generation retrieval code for exoplanetary atmospheres
- Early Release Science of the Exoplanet WASP-39b with JWST NIRSpec G395H
- Photochemically-produced SO in the atmosphere of WASP-39b
- ExoMol molecular line lists XXXV: a rotation-vibration line list for hot ammonia
- ExoMol molecular line lists - XVI: The rotation-vibration spectrum of hot HS
- Early Release Science of the exoplanet WASP-39b with JWST NIRISS
- Mass-Metallicity Trends in Transiting Exoplanets from Atmospheric Abundances of HO, Na, and K
- The 2020 release of the ExoMol database: molecular line lists for exoplanet and other hot atmospheres
- ExoMol line lists -- XXXIX. Ro-vibrational molecular line list for CO
- Early Release Science of the exoplanet WASP-39b with JWST NIRCam
- TauREx III: A fast, dynamic and extendable framework for retrievals
- High Tide or Riptide on the Cosmic Shoreline? A Water-Rich Atmosphere or Stellar Contamination for the Warm Super-Earth GJ~486b from JWST Observations
- The Complete transmission spectrum of WASP-39b with a precise water constraint
- A hybrid line list for CH and hot methane continuum
- The ExoMolOP Database: Cross-sections and k-tables for Molecules of Interest in High-Temperature Exoplanet Atmospheres
- A reflective, metal-rich atmosphere for GJ 1214b from its JWST phase curve
- The Stagger-grid: A grid of 3D stellar atmosphere models - IV. Limb darkening coefficients
- Eureka!: An End-to-End Pipeline for JWST Time-Series Observations
- ExoMol molecular line lists -- XXXVII: spectra of acetylene
- SO2, silicate clouds, but no CH4 detected in a warm Neptune
- Effects of a fully 3D atmospheric structure on exoplanet transmission spectra: retrieval biases due to day-night temperature gradients
- Hot Jupiters: Origins, Structure, Atmospheres
- Why is it so Cold in Here?: Explaining the Cold Temperatures Retrieved from Transmission Spectra of Exoplanet Atmospheres
- Sulphur dioxide in the mid-infrared transmission spectrum of WASP-39b
- The Near-Infrared Spectrograph (NIRSpec) on the James Webb Space Telescope IV. Capabilities and predicted performance for exoplanet characterization
- A comparison of exoplanet spectroscopic retrieval tools
- Hubble WFC3 Spectroscopy of the Habitable-zone Super-Earth LHS 1140 b
- A Benchmark JWST Near-Infrared Spectrum for the Exoplanet WASP-39b
- A comparison of chemical models of exoplanet atmospheres enabled by TauREx 3.1
- Constraining mornings & evenings on distant worlds: a new semi-analytical approach and prospects with transmission spectroscopy
- Outstanding Challenges of Exoplanet Atmospheric Retrievals
- The Impending Opacity Challenge in Exoplanet Atmospheric Characterization
- On the Application of Bayesian Leave-One-Out Cross-Validation to Exoplanet Atmospheric Analysis
- Early Insights for Atmospheric Retrievals of Exoplanets using JWST Transit Spectroscopy
- Towards multi-dimensional analysis of transmission spectroscopy. Part II: Day-night induced biases in retrievals from hot to ultra-hot Jupiters
- An exploration of model degeneracies with a unified phase curve retrieval analysis: The light and dark sides of WASP-43 b
- A Variationally Computed IR Line List for the Methyl Radical CH
- Origin and extent of the opacity challenge for atmospheric retrievals of WASP-39 b
- The transmission spectrum of WASP-17 b from the optical to the near-infrared wavelengths: combining STIS, WFC3 and IRAC datasets
- Measuring Tracers of Planet Formation in the Atmosphere of WASP-77A b: Sub-stellar O/H and C/H ratios, with a stellar C/O ratio and a potentially Super-stellar Ti/H ratio
- Knobs and dials of retrieving JWST transmission spectra. I. The importance of p-T profile complexity
- MIRI-LRS spectrum of a cold exoplanet around a white dwarf: water, ammonia, and methane measurements
- JexoSim 2.0: End-to-End JWST Simulator for Exoplanet Spectroscopy -- Implementation and Case Studies
- Comparing transit spectroscopy pipelines at the catalogue level: evidence for systematic differences
- The effect of spectroscopic binning on atmospheric retrievals
- Is binning always sinning? The impact of time-averaging for exoplanet phase curves
- HST Transmission Spectra of the Hot-Neptune HD 219666 b: Detection of Water and the Challenge of Constraining Both Water and Methane