ProBO: Versatile Bayesian Optimization Using Any Probabilistic Programming Language

Abstract

Optimizing an expensive-to-query function is a common task in science and engineering, where it is beneficial to keep the number of queries to a minimum. A popular strategy is Bayesian optimization (BO), which leverages probabilistic models for this task. Most BO today uses Gaussian processes (GPs), or a few other surrogate models. However, there is a broad set of Bayesian modeling techniques that could be used to capture complex systems and reduce the number of queries in BO. Probabilistic programming languages (PPLs) are modern tools that allow for flexible model definition, prior specification, model composition, and automatic inference. In this paper, we develop ProBO, a BO procedure that uses only standard operations common to most PPLs. This allows a user to drop in a model built with an arbitrary PPL and use it directly in BO. We describe acquisition functions for ProBO, and strategies for efficiently optimizing these functions given complex models or costly inference procedures. Using existing PPLs, we implement new models to aid in a few challenging optimization settings, and demonstrate these on model hyperparameter and architecture search tasks.

References in corpus (15)

• Auto-Encoding Variational Bayes
• Neural Architecture Search with Reinforcement Learning
• The No-U-Turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo
• Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems
• Neural Architecture Search with Bayesian Optimisation and Optimal Transport
• Edward: A library for probabilistic modeling, inference, and criticism
• Learning Disentangled Representations with Semi-Supervised Deep Generative Models
• Student-t Processes as Alternatives to Gaussian Processes
• Bayesian Optimization with Gradients
• Predictive Entropy Search for Bayesian Optimization with Unknown Constraints
• Deep Probabilistic Programming
• Approximate Bayesian Image Interpretation using Generative Probabilistic Graphics Programs
• Deep Amortized Inference for Probabilistic Programs
• Post-Inference Prior Swapping
• Myopic Bayesian Design of Experiments via Posterior Sampling and Probabilistic Programming

Cited by in corpus (5)

• Bayesian Optimization is Superior to Random Search for Machine Learning Hyperparameter Tuning: Analysis of the Black-Box Optimization Challenge 2020
• Tuning Hyperparameters without Grad Students: Scalable and Robust Bayesian Optimisation with Dragonfly
• Pollux: Co-adaptive Cluster Scheduling for Goodput-Optimized Deep Learning
• Uncertainty quantification using martingales for misspecified Gaussian processes
• A Study on Encodings for Neural Architecture Search