Bayesian optimization for computationally extensive probability distributions

Abstract

An efficient method for finding a better maximizer of computationally extensive probability distributions is proposed on the basis of a Bayesian optimization technique. A key idea of the proposed method is to use extreme values of acquisition functions by Gaussian processes for the next training phase, which should be located near a local maximum or a global maximum of the probability distribution. Our Bayesian optimization technique is applied to the posterior distribution in the effective physical model estimation, which is a computationally extensive probability distribution. Even when the number of sampling points on the posterior distributions is fixed to be small, the Bayesian optimization provides a better maximizer of the posterior distributions in comparison to those by the random search method, the steepest descent method, or the Monte Carlo method. Furthermore, the Bayesian optimization improves the results efficiently by combining the steepest descent method and thus it is a powerful tool to search for a better maximizer of computationally extensive probability distributions.

13 pages, 5 figures

References in corpus (6)

• Practical Bayesian Optimization of Machine Learning Algorithms
• Representation of compounds for machine-learning prediction of physical properties
• Markov Chain Monte Carlo Method without Detailed Balance
• Parallelizing Exploration-Exploitation Tradeoffs with Gaussian Process Bandit Optimization
• Method for Estimating Spin-Spin Interactions from Magnetization Curves
• A Case Study Competition Among Methods for Analyzing Large Spatial Data

Cited by in corpus (8)

• Bayesian optimization for tuning and selecting hybrid-density functionals
• Bayesian optimization package: PHYSBO
• Machine learning forces trained by Gaussian process in liquid states: Transferability to temperature and pressure
• Exploration of lattice Hamiltonians for functional and structural discovery via Gaussian Process-based Exploration-Exploitation
• Deep-Learning-Aided Extraction of Optical Constants in Scanning Near-Field Optical Microscopy
• Data-driven determination of the spin Hamiltonian parameters and their uncertainties: The case of the zigzag-chain compound KCu${}_4$P${}_3$O${}_{12}$
• Continuous black-box optimization with quantum annealing and random subspace coding
• Multi-objective optimization for retinal photoisomerization models with respect to experimental observables