CaloDREAM -- Detector Response Emulation via Attentive flow Matching

Abstract

Detector simulations are an exciting application of modern generative networks. Their sparse high-dimensional data combined with the required precision poses a serious challenge. We show how combining Conditional Flow Matching with transformer elements allows us to simulate the detector phase space reliably. Namely, we use an autoregressive transformer to simulate the energy of each layer, and a vision transformer for the high-dimensional voxel distributions. We show how dimension reduction via latent diffusion allows us to train more efficiently and how diffusion networks can be evaluated faster with bespoke solvers. We showcase our framework, CaloDREAM, on datasets 2 and 3 of the CaloChallenge.

References in corpus (70)

• CaloGAN: Simulating 3D High Energy Particle Showers in Multi-Layer Electromagnetic Calorimeters with Generative Adversarial Networks
• Learning Particle Physics by Example: Location-Aware Generative Adversarial Networks for Physics Synthesis
• Accelerating Science with Generative Adversarial Networks: An Application to 3D Particle Showers in Multi-Layer Calorimeters
• Event Generation with Normalizing Flows
• Progressive Distillation for Fast Sampling of Diffusion Models
• How to GAN LHC Events
• OmniFold: A Method to Simultaneously Unfold All Observables
• Getting High: High Fidelity Simulation of High Granularity Calorimeters with High Speed
• Precise simulation of electromagnetic calorimeter showers using a Wasserstein Generative Adversarial Network
• Machine Learning and LHC Event Generation
• JUNIPR: a Framework for Unsupervised Machine Learning in Particle Physics
• AtlFast3: the next generation of fast simulation in ATLAS
• Flow Matching for Generative Modeling
• Calorimetry with Deep Learning: Particle Simulation and Reconstruction for Collider Physics
• i-flow: High-dimensional Integration and Sampling with Normalizing Flows
• Score-based Generative Models for Calorimeter Shower Simulation
• Exploring phase space with Neural Importance Sampling
• Invertible Networks or Partons to Detector and Back Again
• CaloFlow: Fast and Accurate Generation of Calorimeter Showers with Normalizing Flows
• DijetGAN: A Generative-Adversarial Network Approach for the Simulation of QCD Dijet Events at the LHC
• How to GAN away Detector Effects
• Unfolding with Generative Adversarial Networks
• Understanding Event-Generation Networks via Uncertainties
• Accelerating Monte Carlo event generation -- rejection sampling using neural network event-weight estimates
• Event Generators for High-Energy Physics Experiments
• Decoding Photons: Physics in the Latent Space of a BIB-AE Generative Network
• Neural Network-Based Approach to Phase Space Integration
• Generative Networks for Precision Enthusiasts
• Controlling Physical Attributes in GAN-Accelerated Simulation of Electromagnetic Calorimeters
• Fast Point Cloud Generation with Diffusion Models in High Energy Physics
• CaloClouds: Fast Geometry-Independent Highly-Granular Calorimeter Simulation
• EPiC-GAN: Equivariant Point Cloud Generation for Particle Jets
• PC-JeDi: Diffusion for Particle Cloud Generation in High Energy Physics
• MadNIS -- Neural Multi-Channel Importance Sampling
• L2LFlows: Generating High-Fidelity 3D Calorimeter Images
• Improved Neural Network Monte Carlo Simulation
• Reweighting a parton shower using a neural network: the final-state case
• DCTRGAN: Improving the Precision of Generative Models with Reweighting
• How to Understand Limitations of Generative Networks
• Two Invertible Networks for the Matrix Element Method
• Measuring QCD Splittings with Invertible Networks
• CaloMan: Fast generation of calorimeter showers with density estimation on learned manifolds
• Modern Machine Learning for LHC Physicists
• ν-Flows: Conditional Neutrino Regression
• CaloScore v2: Single-shot Calorimeter Shower Simulation with Diffusion Models
• Deep generative models for fast photon shower simulation in ATLAS
• Towards a Deep Learning Model for Hadronization
• Inductive Simulation of Calorimeter Showers with Normalizing Flows
• The MadNIS Reloaded
• PC-Droid: Faster diffusion and improved quality for particle cloud generation
• Efficient phase-space generation for hadron collider event simulation
• Improving Generative Model-based Unfolding with Schrödinger Bridges
• Returning CP-Observables to The Frames They Belong
• Unweighting multijet event generation using factorisation-aware neural networks
• CaloFlow for CaloChallenge Dataset 1
• Ultra-High-Resolution Detector Simulation with Intra-Event Aware GAN and Self-Supervised Relational Reasoning
• New directions for surrogate models and differentiable programming for High Energy Physics detector simulation
• The Landscape of Unfolding with Machine Learning
• ${\nu }^2$-Flows: Fast and improved neutrino reconstruction in multi-neutrino final states with conditional normalizing flows
• Precision-Machine Learning for the Matrix Element Method
• ELSA -- Enhanced latent spaces for improved collider simulations
• Normalizing Flows for High-Dimensional Detector Simulations
• Calorimeter shower superresolution
• EPiC-ly Fast Particle Cloud Generation with Flow-Matching and Diffusion
• Refining Fast Calorimeter Simulations with a Schrödinger Bridge
• CaloShowerGAN, a Generative Adversarial Networks model for fast calorimeter shower simulation
• Towards a data-driven model of hadronization using normalizing flows
• Calo-VQ: Vector-Quantized Two-Stage Generative Model in Calorimeter Simulation
• Bespoke Solvers for Generative Flow Models
• Bespoke Non-Stationary Solvers for Fast Sampling of Diffusion and Flow Models

Cited by in corpus (14)

• A Lorentz-Equivariant Transformer for All of the LHC
• Accurate Surrogate Amplitudes with Calibrated Uncertainties
• CaloChallenge 2022: A Community Challenge for Fast Calorimeter Simulation
• SKATR: A Self-Supervised Summary Transformer for SKA
• Generative Unfolding with Distribution Mapping
• BitHEP -- The Limits of Low-Precision ML in HEP
• Differentiable Surrogate for Detector Simulation and Design with Diffusion Models
• Extrapolating Jet Radiation with Autoregressive Transformers
• Amplitude Uncertainties Everywhere All at Once
• CaloHadronic: a diffusion model for the generation of hadronic showers
• Observable Optimization for Precision Theory: Machine Learning Energy Correlators
• ParaFlow: fast calorimeter simulations parameterized in upstream material configurations
• CaloClouds3: Ultra-Fast Geometry-Independent Highly-Granular Calorimeter Simulation
• Ultra Fast Calorimeter Simulation with Generative Machine Learning on FPGAs