Hyperparameter Optimization of Generative Adversarial Network Models for High-Energy Physics Simulations

Abstract

The Generative Adversarial Network (GAN) is a powerful and flexible tool that can generate high-fidelity synthesized data by learning. It has seen many applications in simulating events in High Energy Physics (HEP), including simulating detector responses and physics events. However, training GANs is notoriously hard and optimizing their hyperparameters even more so. It normally requires many trial-and-error training attempts to force a stable training and reach a reasonable fidelity. Significant tuning work has to be done to achieve the accuracy required by physics analyses. This work uses the physics-agnostic and high-performance-computer-friendly hyperparameter optimization tool HYPPO to optimize and examine the sensitivities of the hyperparameters of a GAN for two independent HEP datasets. This work provides the first insights into efficiently tuning GANs for Large Hadron Collider data. We show that given proper hyperparameter tuning, we can find GANs that provide high-quality approximations of the desired quantities. We also provide guidelines for how to go about GAN architecture tuning using the analysis tools in HYPPO.

arXiv commentSubmitted to Computing and Software for Big Science (October 19, 2022)

References in corpus (21)

• Adam: A Method for Stochastic Optimization
• Auto-Encoding Variational Bayes
• Observation of a new particle in the search for the Standard Model Higgs boson with the ATLAS detector at the LHC
• Denoising Diffusion Probabilistic Models
• Parton distributions for the LHC Run II
• Event generation with SHERPA 1.1
• Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks
• Variational Inference with Normalizing Flows
• Generative Modeling by Estimating Gradients of the Data Distribution
• Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimization
• Event Generation with Sherpa 2.2
• Hyper-Parameter Optimization: A Review of Algorithms and Applications
• CaloGAN: Simulating 3D High Energy Particle Showers in Multi-Layer Electromagnetic Calorimeters with Generative Adversarial Networks
• How to GAN LHC Events
• Computation of the O(p^6) order low-energy constants: an update
• The Metric Space of Collider Events
• Machine Learning and LHC Event Generation
• Unfolding with Generative Adversarial Networks
• Which Metric on the Space of Collider Events?
• Compressing PDF sets using generative adversarial networks
• HYPPO: A Surrogate-Based Multi-Level Parallelism Tool for Hyperparameter Optimization