A Lorentz-Equivariant Transformer for All of the LHC
arXiv:2411.00446 · doi:10.21468/SciPostPhys.19.4.108
Abstract
We show that the Lorentz-Equivariant Geometric Algebra Transformer (L-GATr) yields state-of-the-art performance for a wide range of machine learning tasks at the Large Hadron Collider. L-GATr represents data in a geometric algebra over space-time and is equivariant under Lorentz transformations. The underlying architecture is a versatile and scalable transformer, which is able to break symmetries if needed. We demonstrate the power of L-GATr for amplitude regression and jet classification, and then benchmark it as the first Lorentz-equivariant generative network. For all three LHC tasks, we find significant improvements over previous architectures.
27 pages, 7 figures, 9 tables. v2: added table 5, improved tagging results. v3: added table 7, incorporate feedback
References in corpus (40)
- The automated computation of tree-level and next-to-leading order differential cross sections, and their matching to parton shower simulations
- An Introduction to PYTHIA 8.2
- Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges
- FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
- Symbolic Discovery of Optimization Algorithms
- An Efficient Lorentz Equivariant Graph Neural Network for Jet Tagging
- Machine Learning and LHC Event Generation
- Flow Matching for Generative Modeling
- Event Generators for High-Energy Physics Experiments
- A factorisation-aware Matrix element emulator
- Optimising simulations for diphoton production at hadron colliders using amplitude neural networks
- MadNIS -- Neural Multi-Channel Importance Sampling
- Particle Transformer for Jet Tagging
- Two Invertible Networks for the Matrix Element Method
- Modern Machine Learning for LHC Physicists
- Scalars are universal: Equivariant machine learning, structured like classical physics
- Towards a Deep Learning Model for Hadronization
- Explainable Equivariant Neural Networks for Particle Physics: PELICAN
- The MadNIS Reloaded
- Stochastic Interpolants: A Unifying Framework for Flows and Diffusions
- Improving Generative Model-based Unfolding with Schrödinger Bridges
- One-loop matrix element emulation with factorisation awareness
- End-To-End Latent Variational Diffusion Models for Inverse Problems in High Energy Physics
- The Landscape of Unfolding with Machine Learning
- CaloDREAM -- Detector Response Emulation via Attentive flow Matching
- Precision-Machine Learning for the Matrix Element Method
- Lorentz-Equivariant Geometric Algebra Transformers for High-Energy Physics
- Differentiable MadNIS-Lite
- Jet Tagging with More-Interaction Particle Transformer
- Loop Amplitudes from Precision Networks
- Towards a data-driven model of hadronization using normalizing flows
- PELICAN: Permutation Equivariant and Lorentz Invariant or Covariant Aggregator Network for Particle Physics
- Clifford Group Equivariant Neural Networks
- Geometric Algebra Transformer
- An unfolding method based on conditional Invertible Neural Networks (cINN) using iterative training
- Optimal Equivariant Architectures from the Symmetries of Matrix-Element Likelihoods
- Parton Labeling without Matching: Unveiling Emergent Labelling Capabilities in Regression Models
- Describing Hadronization via Histories and Observables for Monte-Carlo Event Reweighting
- Fitting a Deep Generative Hadronization Model
- Euclidean, Projective, Conformal: Choosing a Geometric Algebra for Equivariant Transformers
Cited by in corpus (13)
- Accelerating multijet-merged event generation with neural network matrix element surrogates
- Extrapolating Jet Radiation with Autoregressive Transformers
- Amplitude Uncertainties Everywhere All at Once
- BitHEP -- The Limits of Low-Precision ML in HEP
- OmniLearned: A Foundation Model Framework for All Tasks Involving Jet Physics
- Amplitude Surrogates for Multi-Jet Processes
- CaloHadronic: a diffusion model for the generation of hadronic showers
- The Physics Behind ML-based Quark-Gluon Taggers
- CaloClouds3: Ultra-Fast Geometry-Independent Highly-Granular Calorimeter Simulation
- Large Language Models -- the Future of Fundamental Physics?
- TIGER: A Topology-Agnostic, Hierarchical Graph Network for Event Reconstruction
- Stable and Interpretable Jet Physics with IRC-Safe Equivariant Feature Extraction
- jBOT: Semantic Jet Representation Clustering Emerges from Self-Distillation