Bayesian optimization for materials design

Abstract

We introduce Bayesian optimization, a technique developed for optimizing time-consuming engineering simulations and for fitting machine learning models on large datasets. Bayesian optimization guides the choice of experiments during materials design and discovery to find good material designs in as few experiments as possible. We focus on the case when materials designs are parameterized by a low-dimensional vector. Bayesian optimization is built on a statistical technique called Gaussian process regression, which allows predicting the performance of a new design based on previously tested designs. After providing a detailed introduction to Gaussian process regression, we introduce two Bayesian optimization methods: expected improvement, for design problems with noise-free evaluations; and the knowledge-gradient method, which generalizes expected improvement and may be used in design problems with noisy evaluations. Both methods are derived using a value-of-information analysis, and enjoy one-step Bayes-optimality.

References in corpus (2)

• Practical Bayesian Optimization of Machine Learning Algorithms
• A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning

Cited by in corpus (34)

• A Tutorial on Bayesian Optimization
• Bayesian Optimization is Superior to Random Search for Machine Learning Hyperparameter Tuning: Analysis of the Black-Box Optimization Challenge 2020
• Automated Reinforcement Learning (AutoRL): A Survey and Open Problems
• Spiderweb nanomechanical resonators via Bayesian optimization: inspired by nature and guided by machine learning
• Parallel Bayesian Global Optimization of Expensive Functions
• ENTMOOT: A Framework for Optimization over Ensemble Tree Models
• Rapid Design of Top-Performing Metal-Organic Frameworks with Qualitative Representations of Building Blocks
• Multi-Objective Constrained Optimization for Energy Applications via Tree Ensembles
• Bayesian Optimization For Multi-Objective Mixed-Variable Problems
• Incorporating Expert Prior in Bayesian Optimisation via Space Warping
• Optimization of the Shape of a Hydrokinetic Turbine's Draft Tube and Hub Assembly Using Design-by-Morphing with Bayesian Optimization
• Non-Stationary Bandits with Habituation and Recovery Dynamics
• Knowing The What But Not The Where in Bayesian Optimization
• Computational design of antimicrobial active surfaces via automated Bayesian optimization
• Accelerating small-angle scattering experiments with simulation-based machine learning
• Scalable Combinatorial Bayesian Optimization with Tractable Statistical models
• A New Knowledge Gradient-based Method for Constrained Bayesian Optimization
• Exciton diffusion in amorphous organic semiconductors: reducing simulation overheads with machine learning
• Machine Learning Forcefield for Silicate Glasses
• Efficient Multi-Objective Constrained Bayesian Optimization of Bridge Girder
• A Principled Approach to Design Using High Fidelity Fluid-Structure Interaction Simulations
• Combining Latent Space and Structured Kernels for Bayesian Optimization over Combinatorial Spaces
• Learning Optimal Data Augmentation Policies via Bayesian Optimization for Image Classification Tasks
• BOSH: Bayesian Optimization by Sampling Hierarchically
• On the development of a practical Bayesian optimisation algorithm for expensive experiments and simulations with changing environmental conditions
• Uncertainty Quantification for Bayesian Optimization
• A Bi-Objective Optimization Based Acquisition Strategy for Batch Bayesian Global Optimization
• Bayesian Optimization with Approximate Set Kernels
• Reinforced Few-Shot Acquisition Function Learning for Bayesian Optimization
• Bayesian Screening: Multi-test Bayesian Optimization Applied to in silico Material Screening
• Multi-Step Bayesian Optimization for One-Dimensional Feasibility Determination
• Constraint-Aware Discrete Black-Box Optimization Using Tensor Decomposition
• Multi-Objective Bayesian Materials Discovery: Application on the Discovery of Precipitation Strengthened NiTi Shape Memory Alloys through Micromechanical Modeling
• Optimizing High-Dimensional Physics Simulations via Composite Bayesian Optimization