Bayesian Non-parametric Quantile Process Regression and Estimation of Marginal Quantile Effects

Abstract

Flexible estimation of multiple conditional quantiles is of interest in numerous applications, such as studying the effect of pregnancy-related factors on low and high birth weight. We propose a Bayesian non-parametric method to simultaneously estimate non-crossing, non-linear quantile curves. We expand the conditional distribution function of the response in I-spline basis functions where the covariate-dependent coefficients are modeled using neural networks. By leveraging the approximation power of splines and neural networks, our model can approximate any continuous quantile function. Compared to existing models, our model estimates all rather than a finite subset of quantiles, scales well to high dimensions, and accounts for estimation uncertainty. While the model is arbitrarily flexible, interpretable marginal quantile effects are estimated using accumulative local effect plots and variable importance measures. A simulation study shows that our model can better recover quantiles of the response distribution when the data is sparse, and an analysis of birth weight data is presented.

arXiv comment53 pages, 22 figures

References in corpus (8)

• Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC
• The No-U-Turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo
• A Widely Applicable Bayesian Information Criterion
• Model-Agnostic Interpretability of Machine Learning
• A Conceptual Introduction to Hamiltonian Monte Carlo
• A Simple and Effective Model-Based Variable Importance Measure
• Nonparametric Conditional Density Estimation in a High-Dimensional Regression Setting
• Fast Nonparametric Conditional Density Estimation

Cited by in corpus (2)

• A review of predictive uncertainty estimation with machine learning
• Modeling Extremal Streamflow using Deep Learning Approximations and a Flexible Spatial Process