Benchmarking the Performance of Bayesian Optimization across Multiple Experimental Materials Science Domains
arXiv:2106.01309
Abstract
In the field of machine learning (ML) for materials optimization, active learning algorithms, such as Bayesian Optimization (BO), have been leveraged for guiding autonomous and high-throughput experimentation systems. However, very few studies have evaluated the efficiency of BO as a general optimization algorithm across a broad range of experimental materials science domains. In this work, we evaluate the performance of BO algorithms with a collection of surrogate model and acquisition function pairs across five diverse experimental materials systems, namely carbon nanotube polymer blends, silver nanoparticles, lead-halide perovskites, as well as additively manufactured polymer structures and shapes. By defining acceleration and enhancement metrics for general materials optimization objectives, we find that for surrogate model selection, Gaussian Process (GP) with anisotropic kernels (automatic relevance detection, ARD) and Random Forests (RF) have comparable performance and both outperform the commonly used GP without ARD. We discuss the implicit distributional assumptions of RF and GP, and the benefits of using GP with anisotropic kernels in detail. We provide practical insights for experimentalists on surrogate model selection of BO during materials optimization campaigns.
References in corpus (7)
- Scikit-learn: Machine Learning in Python
- A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning
- A Tutorial on Bayesian Optimization
- Accelerating high-throughput virtual screening through molecular pool-based active learning
- Gaussian Process Kernels for Pattern Discovery and Extrapolation
- Scalable Global Optimization via Local Bayesian Optimization
- Variable selection for Gaussian processes via sensitivity analysis of the posterior predictive distribution