BORE: Bayesian Optimization by Density-Ratio Estimation
arXiv:2102.09009
Abstract
Bayesian optimization (BO) is among the most effective and widely-used blackbox optimization methods. BO proposes solutions according to an explore-exploit trade-off criterion encoded in an acquisition function, many of which are computed from the posterior predictive of a probabilistic surrogate model. Prevalent among these is the expected improvement (EI) function. The need to ensure analytical tractability of the predictive often poses limitations that can hinder the efficiency and applicability of BO. In this paper, we cast the computation of EI as a binary classification problem, building on the link between class-probability estimation and density-ratio estimation, and the lesser-known link between density-ratios and EI. By circumventing the tractability constraints, this reformulation provides numerous advantages, not least in terms of expressiveness, versatility, and scalability.
arXiv commentpreprint, under review
References in corpus (15)
- Practical Bayesian Optimization of Machine Learning Algorithms
- Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)
- A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning
- Stochastic Gradient Hamiltonian Monte Carlo
- Scalable Bayesian Optimization Using Deep Neural Networks
- Predictive Entropy Search for Efficient Global Optimization of Black-box Functions
- A Downsampled Variant of ImageNet as an Alternative to the CIFAR datasets
- A Tutorial on Bayesian Optimization
- Dealing with Integer-valued Variables in Bayesian Optimization with Gaussian Processes
- Dealing with Categorical and Integer-valued Variables in Bayesian Optimization with Gaussian Processes
- Max-value Entropy Search for Efficient Bayesian Optimization
- Predictive Entropy Search for Multi-objective Bayesian Optimization
- Input Warping for Bayesian Optimization of Non-stationary Functions
- Multi-fidelity Bayesian Optimisation with Continuous Approximations
- Tabular Benchmarks for Joint Architecture and Hyperparameter Optimization