Optimization, fast and slow: optimally switching between local and Bayesian optimization

Mark McLeod, Michael A. Osborne, Stephen J. Roberts

We develop the first Bayesian Optimization algorithm, BLOSSOM, which selects between multiple alternative acquisition functions and traditional local optimization at each step. Thi…