Bayesian Optimization Algorithms for Accelerator Physics
arXiv:2312.05667
Abstract
Accelerator physics relies on numerical algorithms to solve optimization problems in online accelerator control and tasks such as experimental design and model calibration in simulations. The effectiveness of optimization algorithms in discovering ideal solutions for complex challenges with limited resources often determines the problem complexity these methods can address. The accelerator physics community has recognized the advantages of Bayesian optimization algorithms, which leverage statistical surrogate models of objective functions to effectively address complex optimization challenges, especially in the presence of noise during accelerator operation and in resource-intensive physics simulations. In this review article, we offer a conceptual overview of applying Bayesian optimization techniques towards solving optimization problems in accelerator physics. We begin by providing a straightforward explanation of the essential components that make up Bayesian optimization techniques. We then give an overview of current and previous work applying and modifying these techniques to solve accelerator physics challenges. Finally, we explore practical implementation strategies for Bayesian optimization algorithms to maximize their performance, enabling users to effectively address complex optimization challenges in real-time beam control and accelerator design.
References in corpus (29)
- Adam: A Method for Stochastic Optimization
- Scikit-learn: Machine Learning in Python
- An overview of gradient descent optimization algorithms
- Stochastic Backpropagation and Approximate Inference in Deep Generative Models
- A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning
- GPyTorch: Blackbox Matrix-Matrix Gaussian Process Inference with GPU Acceleration
- Gaussian Process Kernels for Pattern Discovery and Extrapolation
- Bayesian optimization of a free-electron laser
- Differentiable Expected Hypervolume Improvement for Parallel Multi-Objective Bayesian Optimization
- Multi-fidelity Bayesian Optimisation with Continuous Approximations
- Multi-Objective Bayesian Optimization for Accelerator Tuning
- Adaptive and Safe Bayesian Optimization in High Dimensions via One-Dimensional Subspaces
- Unexpected Improvements to Expected Improvement for Bayesian Optimization
- High-Dimensional Bayesian Optimization with Sparse Axis-Aligned Subspaces
- Phase Space Reconstruction from Accelerator Beam Measurements Using Neural Networks and Differentiable Simulations
- The reparameterization trick for acquisition functions
- Bayesian optimization of laser-plasma accelerators assisted by reduced physical models
- Differentiable Preisach Modeling for Characterization and Optimization of Accelerator Systems with Hysteresis
- Scalable Constrained Bayesian Optimization
- Bayesian Optimization of the Beam Injection Process into a Storage Ring
- Leveraging Trust for Joint Multi-Objective and Multi-Fidelity Optimization
- Online Bayesian Optimization for a Recoil Mass Separator
- Snowmass'21 Accelerator Frontier Report
- Optimization of the injection beam line at the Cooler Synchrotron COSY using Bayesian Optimization
- Learning to Do or Learning While Doing: Reinforcement Learning and Bayesian Optimisation for Online Continuous Tuning
- Multipoint-BAX: A New Approach for Efficiently Tuning Particle Accelerator Emittance via Virtual Objectives
- Neural Network Prior Mean for Particle Accelerator Injector Tuning
- An optimization method to compensate accelerator performance drifts
- Leveraging Prior Mean Models for Faster Bayesian Optimization of Particle Accelerators