BayesDB: A probabilistic programming system for querying the probable implications of data

Abstract

Is it possible to make statistical inference broadly accessible to non-statisticians without sacrificing mathematical rigor or inference quality? This paper describes BayesDB, a probabilistic programming platform that aims to enable users to query the probable implications of their data as directly as SQL databases enable them to query the data itself. This paper focuses on four aspects of BayesDB: (i) BQL, an SQL-like query language for Bayesian data analysis, that answers queries by averaging over an implicit space of probabilistic models; (ii) techniques for implementing BQL using a broad class of multivariate probabilistic models; (iii) a semi-parametric Bayesian model-builder that auomatically builds ensembles of factorial mixture models to serve as baselines; and (iv) MML, a "meta-modeling" language for imposing qualitative constraints on the model-builder and combining baseline models with custom algorithmic and statistical models that can be implemented in external software. BayesDB is illustrated using three applications: cleaning and exploring a public database of Earth satellites; assessing the evidence for temporal dependence between macroeconomic indicators; and analyzing a salary survey.

Cited by in corpus (9)

• Human Factors in Model Interpretability: Industry Practices, Challenges, and Needs
• The Dataset Nutrition Label: A Framework To Drive Higher Data Quality Standards
• Database Learning: Toward a Database that Becomes Smarter Every Time
• Automating Data Science: Prospects and Challenges
• Probabilistic Data Analysis with Probabilistic Programming
• PClean: Bayesian Data Cleaning at Scale with Domain-Specific Probabilistic Programming
• Probabilistic Search for Structured Data via Probabilistic Programming and Nonparametric Bayes
• Encapsulating models and approximate inference programs in probabilistic modules
• Minority Class Oversampling for Tabular Data with Deep Generative Models