A comparison of quasar emission reconstruction techniques for $z\ge 5.0$ Lyman-$\alpha$ and Lyman-$\beta$ transmission

Abstract

Reconstruction techniques for intrinsic quasar continua are crucial for the precision study of Lyman-$\alpha$ (Ly-$\alpha$) and Lyman-$\beta$ (Ly-$\beta$) transmission at $z>5.0$, where the $\lambda <1215A$ emission of quasars is nearly completely absorbed. While the number and quality of spectroscopic observations has become theoretically sufficient to quantify Ly-$\alpha$ transmission at $5.0<z<6.0$ to better than $1\%$, the biases and uncertainties arising from predicting the unabsorbed continuum are not known to the same level. In this paper, we systematically evaluate eight reconstruction techniques on a unified testing sample of $2.7<z<3.5$ quasars drawn from eBOSS. The methods include power-law extrapolation, stacking of neighbours, and six variants of Principal Component Analysis (PCA) using direct projection, fitting of components, or neural networks to perform weight mapping. We find that power-law reconstructions and the PCA with fewest components and smallest training sample display the largest biases in the Ly-$\alpha$ forest ($-9.58\%/+8.22\%$ respectively). Power-law extrapolations have larger scatters than previously assumed of $+13.1\%/-13.2\%$ over Ly-$\alpha$ and $+19.9\%/-20.1\%$ over Ly-$\beta$. We present two new PCAs which achieve the best current accuracies of $9\%$ for Ly-$\alpha$ and $17\%$ for Ly-$\beta$. We apply the eight techniques after accounting for wavelength-dependent biases and scatter to a sample $19$ quasars at $z>5.7$ with IR X-Shooter spectroscopy, obtaining well-characterised measurements for the mean flux transmission at $4.7<z<6.3$. Our results demonstrate the importance of testing and, when relevant, training, continuum reconstruction techniques in a systematic way.

arXiv commentAccepted for publication in MNRAS; new Appendix added, conclusions unchanged. 13 pages plus Appendix

References in corpus (113)

• Scikit-learn: Machine Learning in Python
• Astropy: A Community Python Package for Astronomy
• The NumPy array: a structure for efficient numerical computation
• The Astropy Project: Building an inclusive, open-science project and status of the v2.0 core package
• LSST: from Science Drivers to Reference Design and Anticipated Data Products
• The Baryon Oscillation Spectroscopic Survey of SDSS-III
• Composite Quasar Spectra From the Sloan Digital Sky Survey
• A luminous quasar at a redshift of z = 7.085
• Constraining the Evolution of the Ionizing Background and the Epoch of Reionization with z ~ 6 Quasars II: A Sample of 19 Quasars
• The DESI Experiment Part I: Science,Targeting, and Survey Design
• X-shooter, the new wide band intermediate resolution spectrograph at the ESO Very Large Telescope
• An 800-million-solar-mass black hole in a significantly neutral Universe at redshift 7.5
• The Multi-Object, Fiber-Fed Spectrographs for SDSS and the Baryon Oscillation Spectroscopic Survey
• A Survey of z>5.8 Quasars in the Sloan Digital Sky Survey I: Discovery of Three New Quasars and the Spatial Density of Luminous Quasars at z~6
• Cosmic Reionization and Early Star-Forming Galaxies: A Joint Analysis of New Constraints from Planck and Hubble Space Telescope
• The SDSS-IV extended Baryon Oscillation Spectroscopic Survey: Overview and Early Data
• An ultra-luminous quasar with a twelve-billion-solar-mass black hole at redshift 6.30
• Damped Lyman alpha Systems
• The Rest-Frame Extreme Ultraviolet Spectral Properties of QSOs
• New Constraints on Cosmic Reionization from the 2012 Hubble Ultra Deep Field Campaign
• Biases in Virial Black Hole Masses: An SDSS Perspective
• Evolution of the Ionizing Background and the Epoch of Reionization from the Spectra of z~6 Quasars
• The Canada-France High-z Quasar Survey: nine new quasars and the luminosity function at redshift 6
• Model-independent evidence in favor of an end to reionization by z~6
• The Sloan Digital Sky Survey Quasar Catalog: Fourteenth Data Release
• The Sloan Digital Sky Survey Quasar Catalog: twelfth data release
• The Lyman-alpha Forest Power Spectrum from the Sloan Digital Sky Survey
• Evidence of patchy hydrogen reionization from an extreme Ly$\alpha$ trough below redshift six
• Unification of Luminous Type 1 Quasars through CIV Emission
• The Pan-STARRS1 distant z>5.6 quasar survey: more than 100 quasars within the first Gyr of the universe
• ESI, a new Keck Observatory echellette spectrograph and imager
• Cosmic Reionization after Planck: Could Quasars Do It All?
• New Measurements of the Ionizing Ultraviolet Background over 2 < z < 5 and Implications for Hydrogen Reionization
• Physical properties of 15 quasars at $z\gtrsim 6.5$
• On Machine-Learned Classification of Variable Stars with Sparse and Noisy Time-Series Data
• Quantitative Constraints on the Reionization History from the IGM Damping Wing Signature in Two Quasars at z > 7
• The Discovery of a Luminous z=5.80 Quasar from the Sloan Digital Sky Survey
• Probing the Ionization State of the Universe at z>6
• How accurately can 21 cm tomography constrain cosmology?
• Improved redshifts for SDSS quasar spectra
• Spectral Classification of Quasars in the Sloan Digital Sky Survey: Eigenspectra; Redshift and Luminosity Effects
• Large Lyman-alpha opacity fluctuations and low CMB tau in models of late reionization with large islands of neutral hydrogen extending to z<5.5
• Four quasars above redshift 6 discovered by the Canada-France High-z Quasar Survey
• A Direct Precision Measurement of the Intergalactic Lyman-alpha Opacity at 2<z<4.2
• Colors of 2625 Quasars at 0<z<5 Measured in the Sloan Digital Sky Survey Photometric System
• Rapidly star-forming galaxies adjacent to quasars at redshifts exceeding 6
• A Composite Extreme Ultraviolet QSO Spectrum from the Far Ultraviolet Spectroscopic Explorer
• New constraints on Lyman-α opacity with a sample of 62 quasars at z > 5.7
• The Evolution of the Intergalactic Medium Transmission to Redshift Six
• Gemini GNIRS near-infrared spectroscopy of 50 quasars at z>~5.7
• Long troughs in the Lyman-$\alpha$ forest below redshift 6 due to islands of neutral hydrogen
• The Neutral Hydrogen Cosmological Mass Density at z=5
• Are we witnessing the epoch of reionisation at $z=7.1$ from the spectrum of J1120+0641?
• The LyA-LyC Connection: Evidence for an Enhanced Contribution of UV-faint Galaxies to Cosmic Reionization
• The Opacity of the Intergalactic Medium Measured Along Quasar Sightlines at $z\sim 6$
• HST-COS Observations of AGN. I. Ultraviolet Composite Spectra of the Ionizing Continuum and Emission Lines
• Star formation rate and dynamical mass of 10^8 solar mass black hole host galaxies at redshift 6
• A Direct Measurement of the IGM Opacity to HI Ionizing Photons
• Revealing reionization with the thermal history of the intergalactic medium: new constraints from the Lyman-$\alpha$ flux power spectrum
• Large Fluctuations in the High-Redshift Metagalactic Ionizing Background
• Large fluctuations in the hydrogen-ionizing background and mean free path following the epoch of reionization
• Physical effects on the Lyman-alpha forest flux power spectrum: damping wings, ionizing radiation fluctuations, and galactic winds
• The Rapid Decline in Metallicity of Damped Ly-alpha Systems at z~5
• Eight new luminous z > 6 quasars selected via SED model fitting of VISTA, WISE and Dark Energy Survey Year 1 Observations
• Probing the thermal state of the intergalactic medium at $z>5$ with the transmission spikes in high-resolution Ly$\alpha$ forest spectra
• A Principal Component Analysis of quasar UV spectra at z~3
• CIV Emission Line Properties and Systematic Trends in Quasar Black Hole Mass Estimates
• Observing the tail of reionization: neutral islands in the $z=5.5$ Lyman-$\alpha$ Forest
• Ionization near-zones associated with quasars at z ~ 6
• XQ-100: A legacy survey of one hundred 3.5 < z < 4.5 quasars observed with VLT/XSHOOTER
• Approaching Reionization: The Evolution of the Lyman Alpha Forest from Redshifts Four to Six
• The first (nearly) model-independent constraint on the neutral hydrogen fraction at z~5--6
• An unbiased measurement of the UV background and its evolution via the proximity effect in quasar spectra
• Large Opacity Variations in the High-Redshift Lyman-alpha Forest: the Signature of Relic Temperature Fluctuations from Patchy Reionization
• A survey of luminous high-redshift quasars with SDSS and WISE. I. target selection and optical spectroscopy
• BAL and non-BAL quasars: continuum, emission and absorption properties establish a common parent sample
• Constraints on the Universal CIV Mass Density at z~6 from Early IR Spectra Obtained with the Magellan FIRE Spectrograph
• Detecting and Characterizing Young Quasars I: Systemic Redshifts and Proximity Zones Measurements
• Constraining the reionization history with QSO absorption spectra
• Predicting QSO Continua in the Ly Alpha Forest
• Evidence for Large-Scale Fluctuations in the Metagalactic Ionizing Background Near Redshift Six
• IGM Constraints from the SDSS-III/BOSS DR9 Ly-alpha Forest Flux Probability Distribution Function
• Predicting Quasar Continua Near Lyman-$\alpha$ with Principal Component Analysis
• Discovery of a redshift 6.13 quasar in the UKIRT Infrared Deep Sky Survey
• Mean-flux Regulated PCA Continuum Fitting of SDSS Lyman-alpha Forest Spectra
• The Role of Galaxies and AGN in Reionising the IGM - I: Keck Spectroscopy of 5 < z < 7 Galaxies in the QSO Field J1148+5251
• New Constraints on Quasar Evolution: Broad Line Velocity Shifts over $1.5\lesssim z\lesssim 7.5$
• How Universal is the Gunn-Peterson Trough at z~6?: A Closer Look at the Quasar SDSS J1148+5251
• Have We Detected Patchy Reionization in Quasar Spectra?
• The Discovery of Three New z>5 Quasars in the AGN and Galaxy Evolution Survey
• Three Lyman-alpha emitting galaxies within a quasar proximity zone at z=5.8
• Discovery of Eight z ~ 6 Quasars in the Sloan Digital Sky Survey Overlap Regions
• Studying the Lyman-$\alpha$ optical depth fluctuations at $z\sim 5.5$ using fast semi-numerical methods
• Reionization history constraints from neural network based predictions of high-redshift quasar continua
• Inferring the IGM thermal history during reionisation with the Lyman-$\alpha$ forest power spectrum at redshift $z\simeq 5$
• Improved Spectrophotometric Calibration of the SDSS-III BOSS Quasar Sample
• The role of galaxies and AGN in reionising the IGM -- III : IGM-galaxy cross-correlations at z~6 from 8 quasar fields with DEIMOS and MUSE
• Constraining Reionization with the $z\sim 5-6$ Lyman-$\alpha$ Forest Power Spectrum: the Outlook after Planck
• Re-examining the case for neutral gas near the redshift 7 quasar ULAS J1120+0641
• Two more, bright, z > 6 quasars from VST ATLAS and WISE
• The role of galaxies and AGN in reionizing the IGM - II: metal-tracing the faint sources of reionization at $5\lesssim z\lesssim 6$
• The Evolution of the HeII-Ionizing Background at Redshifts 2.3<z<3.8 Inferred from a Statistical Sample of 24 HST/COS HeII Ly$\alpha$ Absorption Spectra
• Cosmic Reionization On Computers. Properties of the Post-reionization IGM
• Determining the Nature of Late Gunn-Peterson Troughs with Galaxy Surveys
• Evidence for a highly opaque large-scale galaxy void at the end of reionization
• Anomaly in the Opacity of the Post-Reionization Intergalactic Medium in the Ly$\alpha$ and Ly$\beta$ Forest
• A Deep Learning Approach to Quasar Continuum Prediction
• The influence of metagalactic ultra-violet background fluctuations on the high-redshift Ly$\alpha$ forest
• A tale of seven narrow spikes and a long trough: constraining the timing of the percolation of HII bubbles at the tail-end of reionization with ULAS J1120+0641
• The Cosmological Bias Factor of Damped Lyman Alpha systems: Dependence on Metal Line Strength
• Design drivers for a wide-field multi-object spectrograph for the William Herschel Telescope
• Deep Learning Prediction of Quasars Broad Ly$\alpha$ Emission Line
• The UV background photoionization rate at 2.3 < z < 4.6 as measured from the Sloan Digital Sky Survey

Cited by in corpus (29)

• Hydrogen reionisation ends by $z=5.3$: Lyman-$\alpha$ optical depth measured by the XQR-30 sample
• Reionization and galaxy inference from the high-redshift Lyα forest
• Long Dark Gaps in the Ly$\beta$ Forest at $z<6$: Evidence of Ultra Late Reionization from XQR-30 Spectra
• IGM damping wing constraints on reionisation from covariance reconstruction of two $z\gtrsim 7$ QSOs
• (Nearly) Model-Independent Constraints on the Neutral Hydrogen Fraction in the Intergalactic Medium at $z\sim 5-7$ Using Dark Pixel Fractions in Ly$\alpha$ and Ly$\beta$ Forests
• XQR-30: the ultimate XSHOOTER quasar sample at the reionization epoch
• Chasing the Tail of Cosmic Reionization with Dark Gap Statistics in the Ly$\alpha$ Forest over $5<z<6$
• Detecting and Characterizing Young Quasars II: Four Quasars at $z\sim 6$ with Lifetimes $<10^4$ years
• Chronicling the reionization history at $6\lesssim z\lesssim 7$ with emergent quasar damping wings
• Damping Wing-Like Features in the Stacked Ly$\alpha$ Forest: Potential Neutral Hydrogen Islands at $z<6$
• Damping wings in the Lyman-α forest: a model-independent measurement of the neutral fraction at 5.4<z<6.1
• Estimating the effective lifetime of the $z\sim 6$ quasar population from the composite proximity zone profile
• Constraining galaxy overdensities around three z~6.5 quasars with ALMA and MUSE
• Measuring the Density Fields around Bright Quasars at $z\sim 6$ with XQR-30 Spectra
• A Deep Learning Approach to Quasar Continuum Prediction
• Quasar Factor Analysis -- An Unsupervised and Probabilistic Quasar Continuum Prediction Algorithm with Latent Factor Analysis
• Possible evidence for a large-scale enhancement in the Lyman-$\alpha$ forest power spectrum at redshift $\text{z}\ge 4$
• A Generative Model for Quasar Spectra
• Probing patchy reionisation with JWST: IGM opacity constraints from the Lyman-$\alpha$ forest of galaxies in legacy extragalactic fields
• Modeling Post-Reionization HI Distributions in Fuzzy Dark Matter Cosmologies Using Conditional Normalizing Flows
• Optical and near-infrared spectroscopy of quasars at $z>6.5$: public data release and composite spectrum
• Recovering Density Fields inside Quasar Proximity Zones at $z\sim 6$
• Calibrating excursion set reionization models to approximately conserve ionizing photons
• Detecting and Characterizing Young Quasars. III. The Impact of Gravitational Lensing Magnification
• High-redshift AGN population in radiation-hydrodynamics simulations
• Efficient Modelling of Lyman-α opacity fluctuations during late reionization epoch
• QUEST (Quasar Unsupervised Encoder and Synthesis Tool): A machine learning framework to generate quasar spectra
• Measuring the IGM correlation length at 5<z<6.1: a fast change at the end of Reionization
• Quantifying and mitigating the effect of snapshot interval in light-cone Epoch of Reionization 21-cm simulations