Bayesian Optimization with Unknown Constraints

Abstract

Recent work on Bayesian optimization has shown its effectiveness in global optimization of difficult black-box objective functions. Many real-world optimization problems of interest also have constraints which are unknown a priori. In this paper, we study Bayesian optimization for constrained problems in the general case that noise may be present in the constraint functions, and the objective and constraints may be evaluated independently. We provide motivating practical examples, and present a general framework to solve such problems. We demonstrate the effectiveness of our approach on optimizing the performance of online latent Dirichlet allocation subject to topic sparsity constraints, tuning a neural network given test-time memory constraints, and optimizing Hamiltonian Monte Carlo to achieve maximal effectiveness in a fixed time, subject to passing standard convergence diagnostics.

14 pages, 3 figures

References in corpus (2)

• A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning
• Elliptical slice sampling

Cited by in corpus (53)

• Safe Controller Optimization for Quadrotors with Gaussian Processes
• CMA-ES for Hyperparameter Optimization of Deep Neural Networks
• A Bayesian approach to constrained single- and multi-objective optimization
• Predictive Entropy Search for Multi-objective Bayesian Optimization
• An Efficient Batch Constrained Bayesian Optimization Approach for Analog Circuit Synthesis via Multi-objective Acquisition Ensemble
• Differentiable Expected Hypervolume Improvement for Parallel Multi-Objective Bayesian Optimization
• Freeze-Thaw Bayesian Optimization
• Data-efficient Auto-tuning with Bayesian Optimization: An Industrial Control Study
• Predictive Entropy Search for Multi-objective Bayesian Optimization with Constraints
• Multi-Fidelity Cost-Aware Bayesian Optimization
• Stagewise Safe Bayesian Optimization with Gaussian Processes
• Greenhouse Gas Emission Prediction on Road Network using Deep Sequence Learning
• Deep Manifold Traversal: Changing Labels with Convolutional Features
• Towards Dynamic and Safe Configuration Tuning for Cloud Databases
• Upper Trust Bound Feasibility Criterion for Mixed Constrained Bayesian Optimization with Application to Aircraft Design
• Constrained Bayesian Optimization for Automatic Chemical Design
• A Full-Stack Search Technique for Domain Optimized Deep Learning Accelerators
• Bayesian optimization under mixed constraints with a slack-variable augmented Lagrangian
• Parallel Bayesian Optimization of Multiple Noisy Objectives with Expected Hypervolume Improvement
• Distributionally Robust Bayesian Optimization
• c-TPE: Tree-structured Parzen Estimator with Inequality Constraints for Expensive Hyperparameter Optimization
• Scalable Constrained Bayesian Optimization
• Failure-averse Active Learning for Physics-constrained Systems
• Finding safe 3D robot grasps through efficient haptic exploration with unscented Bayesian optimization and collision penalty
• Kalman Filter Tuning with Bayesian Optimization
• An informative path planning framework for UAV-based terrain monitoring
• Surrogate-based optimization of system architectures subject to hidden constraints
• A New Knowledge Gradient-based Method for Constrained Bayesian Optimization
• Recognition of food-texture attributes using an in-ear microphone
• A Bandit-Based Algorithm for Fairness-Aware Hyperparameter Optimization
• FLASH: A Faster Optimizer for SBSE Tasks
• Rapid Bayesian optimisation for synthesis of short polymer fiber materials
• Multiresolution Mapping and Informative Path Planning for UAV-based Terrain Monitoring
• Designing Adaptive Neural Networks for Energy-Constrained Image Classification
• Probabilistic Programming with Gaussian Process Memoization
• Discretization-free Knowledge Gradient Methods for Bayesian Optimization
• Data-Driven Offline Optimization For Architecting Hardware Accelerators
• Sequential- and Parallel- Constrained Max-value Entropy Search via Information Lower Bound
• A General Framework for Constrained Bayesian Optimization using Information-based Search
• Data-Driven Security Assessment of the Electric Power System
• Occupancy Map Building through Bayesian Exploration
• Regional medical inter-institutional cooperation in medical provider network constructed using patient claims data from Japan
• Constrained Discrete Black-Box Optimization using Mixed-Integer Programming
• ESCADA: Efficient Safety and Context Aware Dose Allocation for Precision Medicine
• Predicting Patient State-of-Health using Sliding Window and Recurrent Classifiers
• Funneled Bayesian Optimization for Design, Tuning and Control of Autonomous Systems
• Human-in-the-Loop Robot Planning with Non-Contextual Bandit Feedback
• Speed-Constrained Tuning for Statistical Machine Translation Using Bayesian Optimization
• Classified Regression for Bayesian Optimization: Robot Learning with Unknown Penalties
• Online Preconditioning of Experimental Inkjet Hardware by Bayesian Optimization in Loop
• Sonic: A Sampling-based Online Controller for Streaming Applications
• Interactive Optimization of Generative Image Modeling using Sequential Subspace Search and Content-based Guidance
• C-GLISp: Preference-Based Global Optimization under Unknown Constraints with Applications to Controller Calibration