A flexible method for estimating luminosity functions via Kernel Density Estimation

Abstract

We propose a flexible method for estimating luminosity functions (LFs) based on kernel density estimation (KDE), the most popular nonparametric density estimation approach developed in modern statistics, to overcome issues surrounding binning of LFs. One challenge in applying KDE to LFs is how to treat the boundary bias problem, since astronomical surveys usually obtain truncated samples predominantly due to the flux-density limits of surveys. We use two solutions, the transformation KDE method (${\hat{\varphi }}_{\mathrm{t}}$), and the transformation-reflection KDE method (${\hat{\varphi }}_{\mathrm{tr}}$) to reduce the boundary bias. We develop a new likelihood cross-validation criterion for selecting optimal bandwidths, based on which, the posterior probability distribution of bandwidth and transformation parameters for ${\hat{\varphi }}_{\mathrm{t}}$ and ${\hat{\varphi }}_{\mathrm{tr}}$ are derived within a Markov chain Monte Carlo (MCMC) sampling procedure. The simulation result shows that ${\hat{\varphi }}_{\mathrm{t}}$ and ${\hat{\varphi }}_{\mathrm{tr}}$ perform better than the traditional binned method, especially in the sparse data regime around the flux-limit of a survey or at the bright-end of the LF. To further improve the performance of our KDE methods, we develop the transformation-reflection adaptive KDE approach (${\hat{\varphi }}_{\mathrm{tra}}$). Monte Carlo simulations suggest that it has a good stability and reliability in performance, and is around an order of magnitude more accurate than using the binned method. By applying our adaptive KDE method to a quasar sample, we find that it achieves estimates comparable to the rigorous determination by a previous work, while making far fewer assumptions about the LF. The KDE method we develop has the advantages of both parametric and non-parametric methods.

23 pages, accepted for publication in The Astrophysical Journal Supplement Series

References in corpus (42)

• emcee: The MCMC Hammer
• Cosmological parameters from CMB and other data: a Monte-Carlo approach
• Kernel density estimation via diffusion
• UV Luminosity Functions at redshifts z~4 to z~10: 10000 Galaxies from HST Legacy Fields
• Galaxy Luminosity Functions to z~1: DEEP2 vs. COMBO-17 and Implications for Red Galaxy Formation
• Cosmological Evolution of the Hard X-ray AGN Luminosity Function and the Origin of the Hard X-ray Background
• The 2dF Galaxy Redshift Survey: Near Infrared Galaxy Luminosity Functions
• The SDSS Quasar Survey: Quasar Luminosity Function from Data Release Three
• Constraining Galaxy Formation and Cosmology with the Conditional Luminosity Function of Galaxies
• Luminosity-dependent evolution of soft X-ray selected AGN: New Chandra and XMM-Newton surveys
• The 2dF QSO Redshift Survey - I. The Optical QSO Luminosity Function
• The evolution of the hard X-ray luminosity function of AGN
• The radio luminosity function from the low-frequency 3CRR, 6CE & 7CRS complete samples
• The Luminosity Function of Fermi-detected Flat-Spectrum Radio Quasars
• Evolution of the AGN UV luminosity function from redshift 7.5
• The galaxy luminosity function at z ~ 6 and evidence for rapid evolution in the bright end from z ~ 7 to 5
• An improved method of constructing binned luminosity functions
• A model for the cosmological evolution of low frequency radio sources
• A survey of luminous high-redshift quasars with SDSS and WISE II. the bright end of the quasar luminosity function at z ~ 5
• Shedding Light on the Galaxy Luminosity Function
• The MUSE-Wide Survey: A determination of the Lyman $\alpha$ emitter luminosity function at $3<z<6$
• On the Radio and Optical Luminosity Evolution of Quasars
• fgivenx: A Python package for functional posterior plotting
• The Build-up of the Red Sequence in the galaxy cluster MS1054-0321 at z=0.831
• Emitting electrons spectra and acceleration processes in the jet of Mrk 421: from low state to giant flare state
• On the redshift cut-off for flat-spectrum radio sources
• Rigorous luminosity function determination in presence of a background: theory and application to two intermediate redshift clusters
• On the redshift cut-off for steep-spectrum radio sources
• A Flexible Method of Estimating Luminosity Functions
• The galaxy-halo connection in the VIDEO Survey at 0.5<z<1.7
• Faint end of the $z\sim 3-7$ luminosity function of Lyman-alpha emitters behind lensing clusters observed with MUSE
• The Luminosity Function and Formation Rate of A Complete Sample of Long Gamma-Ray Bursts
• Does the evolution of the radio luminosity function of star-forming galaxies match that of the star-formation rate function?
• Gamma-ray Luminosity and Photon Index Evolution of FSRQ Blazars and Contribution to the Gamma-ray Background
• A Statistical Method for Estimating Luminosity Functions using Truncated Data
• Optical characterization of WISE selected blazar candidates
• A mixture evolution scenario of the AGN radio luminosity function. II. Do low- and high-power radio-loud AGNs evolve differently?
• A graphical analysis of the systematic error of classical binned methods in constructing luminosity functions
• A mixture evolution scenario of the AGN radio luminosity function
• Avoiding spurious breaks in binned luminosity functions
• Robust statistics toward detection of the 21 cm signal from the Epoch of Reionisation
• Effect of spectral index distribution on estimating the AGN radio luminosity function

Cited by in corpus (6)

• On the cosmic evolution of AGN obscuration and the X-ray luminosity function: XMM-Newton and Chandra spectral analysis of the 31.3 deg${}^2$ Stripe 82X
• The PAU Survey: Measurement of Narrow-band galaxy properties with Approximate Bayesian Computation
• Two-point statistics without bins: A continuous-function generalization of the correlation function estimator for large-scale structure
• Insights into environmental quenching at $z\sim 1$: an enhancement of faint, low-mass passive galaxies in clusters
• A flexible method for estimating luminosity functions via Kernel Density Estimation -- II. Generalization and Python implementation
• ScaleFree: Dynamic KDE for Multiscale Point Cloud Exploration in VR