Injection Optimization at Particle Accelerators via Reinforcement Learning: From Simulation to Real-World Application
arXiv:2406.12735 · doi:10.1103/PhysRevAccelBeams.28.034601
Abstract
Optimizing the injection process in particle accelerators is crucial for enhancing beam quality and operational efficiency. This paper presents a framework for utilizing Reinforcement Learning (RL) to optimize the injection process at accelerator facilities. By framing the optimization challenge as an RL problem, we developed an agent capable of dynamically aligning the beam's transverse space with desired targets. Our methodology leverages the Soft Actor-Critic algorithm, enhanced with domain randomization and dense neural networks, to train the agent in simulated environments with varying dynamics promoting it to learn a generalized robust policy. The agent was evaluated in live runs at the Cooler Synchrotron COSY and it has successfully optimized the beam cross-section reaching human operator level but in notably less time. An empirical study further validated the importance of each architecture component in achieving a robust and generalized optimization strategy. The results demonstrate the potential of RL in automating and improving optimization tasks at particle acceleration facilities.
19 pages, 8 figures
References in corpus (10)
- Proceedings of the 29th International Conference on Machine Learning (ICML-12)
- Sim-to-Real Transfer of Robotic Control with Dynamics Randomization
- Guided Cost Learning: Deep Inverse Optimal Control via Policy Optimization
- Evidence for a New Resonance from Polarized Neutron-Proton Scattering
- Bayesian optimization of a free-electron laser
- Machine learning applied to single-shot x-ray diagnostics in an XFEL
- Superconducting radio-frequency cavity fault classification using machine learning at Jefferson Laboratory
- First Search for Axion-Like Particles in a Storage Ring Using a Polarized Deuteron Beam
- Optimization of the injection beam line at the Cooler Synchrotron COSY using Bayesian Optimization
- The legacy of the experimental hadron physics programme at COSY