OpenBox: A Generalized Black-box Optimization Service

Abstract

Black-box optimization (BBO) has a broad range of applications, including automatic machine learning, engineering, physics, and experimental design. However, it remains a challenge for users to apply BBO methods to their problems at hand with existing software packages, in terms of applicability, performance, and efficiency. In this paper, we build OpenBox, an open-source and general-purpose BBO service with improved usability. The modular design behind OpenBox also facilitates flexible abstraction and optimization of basic BBO components that are common in other existing systems. OpenBox is distributed, fault-tolerant, and scalable. To improve efficiency, OpenBox further utilizes "algorithm agnostic" parallelization and transfer learning. Our experimental results demonstrate the effectiveness and efficiency of OpenBox compared to existing systems.

References in corpus (2)

• Predictive Entropy Search for Multi-objective Bayesian Optimization with Constraints
• Efficient Automatic CASH via Rising Bandits

Cited by in corpus (11)

• Multi-Objective Hyperparameter Optimization in Machine Learning -- An Overview
• BlindFL: Vertical Federated Machine Learning without Peeking into Your Data
• PaSca: a Graph Neural Architecture Search System under the Scalable Paradigm
• Grain: Improving Data Efficiency of Graph Neural Networks via Diversified Influence Maximization
• Efficient End-to-End AutoML via Scalable Search Space Decomposition
• Towards General and Efficient Online Tuning for Spark
• TransBO: Hyperparameter Optimization via Two-Phase Transfer Learning
• System Architecture Optimization Strategies: Dealing with Expensive Hierarchical Problems
• Regularized boosting with an increasing coefficient magnitude stop criterion as meta-learner in hyperparameter optimization stacking ensemble
• Transfer Learning based Search Space Design for Hyperparameter Tuning
• General Automatic Solution Generation of Social Problems