Bayesian optimization for computationally extensive probability distributions
arXiv:1803.04577 · doi:10.1371/journal.pone.0193785
Abstract
An efficient method for finding a better maximizer of computationally extensive probability distributions is proposed on the basis of a Bayesian optimization technique. A key idea of the proposed method is to use extreme values of acquisition functions by Gaussian processes for the next training phase, which should be located near a local maximum or a global maximum of the probability distribution. Our Bayesian optimization technique is applied to the posterior distribution in the effective physical model estimation, which is a computationally extensive probability distribution. Even when the number of sampling points on the posterior distributions is fixed to be small, the Bayesian optimization provides a better maximizer of the posterior distributions in comparison to those by the random search method, the steepest descent method, or the Monte Carlo method. Furthermore, the Bayesian optimization improves the results efficiently by combining the steepest descent method and thus it is a powerful tool to search for a better maximizer of computationally extensive probability distributions.
arXiv comment13 pages, 5 figures
References in corpus (15)
- Practical Bayesian Optimization of Machine Learning Algorithms
- An efficient, multiple range random walk algorithm to calculate the density of states
- Exchange Monte Carlo Method and Application to Spin Glass Simulations
- Gaussian Process Optimization in the Bandit Setting: No Regret and Experimental Design
- Corner Transfer Matrix Renormalization Group Method
- Representation of compounds for machine-learning prediction of physical properties
- Machine learning with systematic density-functional theory calculations: Application to melting temperatures of single and binary component solids
- Density Matrix Renormalization Group Method for 2D Classical Models
- First-Principles Study of the Honeycomb-Lattice Iridates Na2IrO3 in the Presence of Strong Spin-Orbit Interaction and Electron Correlations
- Markov Chain Monte Carlo Method without Detailed Balance
- Recent Developments of World-Line Monte Carlo Methods
- Parallelizing Exploration-Exploitation Tradeoffs with Gaussian Process Bandit Optimization
- A machine learning-based selective sampling procedure for identifying the low energy region in a potential energy surface: a case study on proton conduction in oxides
- Method for Estimating Spin-Spin Interactions from Magnetization Curves
- A Case Study Competition Among Methods for Analyzing Large Spatial Data
Cited by in corpus (8)
- Bayesian optimization for tuning and selecting hybrid-density functionals
- Bayesian optimization package: PHYSBO
- Machine learning forces trained by Gaussian process in liquid states: Transferability to temperature and pressure
- Exploration of lattice Hamiltonians for functional and structural discovery via Gaussian Process-based Exploration-Exploitation
- Deep-Learning-Aided Extraction of Optical Constants in Scanning Near-Field Optical Microscopy
- Data-driven determination of the spin Hamiltonian parameters and their uncertainties: The case of the zigzag-chain compound KCuPO
- Continuous black-box optimization with quantum annealing and random subspace coding
- Multi-objective optimization for retinal photoisomerization models with respect to experimental observables