Lorentz-Equivariant Geometric Algebra Transformers for High-Energy Physics

Abstract

Extracting scientific understanding from particle-physics experiments requires solving diverse learning problems with high precision and good data efficiency. We propose the Lorentz Geometric Algebra Transformer (L-GATr), a new multi-purpose architecture for high-energy physics. L-GATr represents high-energy data in a geometric algebra over four-dimensional space-time and is equivariant under Lorentz transformations, the symmetry group of relativistic kinematics. At the same time, the architecture is a Transformer, which makes it versatile and scalable to large systems. L-GATr is first demonstrated on regression and classification tasks from particle physics. We then construct the first Lorentz-equivariant generative model: a continuous normalizing flow based on an L-GATr network, trained with Riemannian flow matching. Across our experiments, L-GATr is on par with or outperforms strong domain-specific baselines.

10+12 pages, 5+2 figures, 2 tables. v2: extended acknowledgements, added link to github repo. v3: improved results, matches NeurIPS camera-ready version

Cited by in corpus (12)

• A Lorentz-Equivariant Transformer for All of the LHC
• Convolutional L2LFlows: Generating Accurate Showers in Highly Granular Calorimeters Using Convolutional Normalizing Flows
• Accurate Surrogate Amplitudes with Calibrated Uncertainties
• Advancing Tools for Simulation-Based Inference
• Describing Hadronization via Histories and Observables for Monte-Carlo Event Reweighting
• Generative Unfolding with Distribution Mapping
• Fast Jet Tagging with MLP-Mixers on FPGAs
• Amplitude Uncertainties Everywhere All at Once
• Extrapolating Jet Radiation with Autoregressive Transformers
• How to Unfold Top Decays
• Amplitude Surrogates for Multi-Jet Processes
• Large Language Models -- the Future of Fundamental Physics?