Symmetries, Safety, and Self-Supervision

Abstract

Collider searches face the challenge of defining a representation of high-dimensional data such that physical symmetries are manifest, the discriminating features are retained, and the choice of representation is new-physics agnostic. We introduce JetCLR to solve the mapping from low-level data to optimized observables though self-supervised contrastive learning. As an example, we construct a data representation for top and QCD jets using a permutation-invariant transformer-encoder network and visualize its symmetry properties. We compare the JetCLR representation with alternative representations using linear classifier tests and find it to work quite well.

References in corpus (51)

• Array Programming with NumPy
• The anti-k_t jet clustering algorithm
• An Introduction to PYTHIA 8.2
• FastJet user manual
• DELPHES 3, A modular framework for fast simulation of a generic collider experiment
• Dispelling the N^3 myth for the Kt jet-finder
• Jet substructure as a new Higgs search channel at the LHC
• Jet Trimming
• ParticleNet: Jet Tagging via Particle Clouds
• Maximizing Boosted Top Identification by Minimizing N-subjettiness
• Fat Jets for a Light Higgs
• Techniques for improved heavy particle searches with jet substructure
• Anomaly Detection with Density Estimation
• Classification without labels: Learning from mixed samples in high energy physics
• Deep learning in color: towards automated quark/gluon jet discrimination
• Jet-Images -- Deep Learning Edition
• Deep-learning Top Taggers or The End of QCD?
• Searching for New Physics with Deep Autoencoders
• Energy Flow Networks: Deep Sets for Particle Jets
• The Machine Learning Landscape of Top Taggers
• Deep-learned Top Tagging with a Lorentz Layer
• Jet-Images: Computer Vision Inspired Techniques for Jet Tagging
• Graph Neural Networks in Particle Physics
• QCD or What?
• Energy flow polynomials: A complete linear basis for jet substructure
• Learning representations of irregular particle-detector geometry with distance-weighted graph networks
• Pulling Out All the Tops with Computer Vision and Deep Learning
• The Lund Jet Plane
• QCD-Aware Recursive Neural Networks for Jet Physics
• JUNIPR: a Framework for Unsupervised Machine Learning in Particle Physics
• Uncovering latent jet substructure
• ABCNet: An attention-based method for particle tagging
• Better Latent Spaces for Better Autoencoders
• Lorentz Group Equivariant Neural Network for Particle Physics
• Bump Hunting in Latent Space
• ABCDisCo: Automating the ABCD Method with Machine Learning
• Point Cloud Transformers applied to Collider Physics
• Learning the latent structure of collider events
• Lund jet images from generative and cycle-consistent adversarial networks
• Interpretable Deep Learning for Two-Prong Jet Classification with Jet Spectra
• Supervised Jet Clustering with Graph Neural Networks for Lorentz Boosted Bosons
• SPANet: Generalized Permutationless Set Assignment for Particle Physics using Symmetry Preserving Attention
• Comparing Weak- and Unsupervised Methods for Resonant Anomaly Detection
• Lorentz Boost Networks: Autonomous Physics-Inspired Feature Engineering
• Deep Set Auto Encoders for Anomaly Detection in Particle Physics
• Unsupervised Hadronic SUEP at the LHC
• Symmetry meets AI
• Unburied Higgs
• Shared Data and Algorithms for Deep Learning in Fundamental Physics
• Revealing systematics in phenomenologically viable flux vacua with reinforcement learning
• Particle Convolution for High Energy Physics

Cited by in corpus (28)

• Calomplification -- The Power of Generative Calorimeter Models
• Self-supervised Anomaly Detection for New Physics
• Learning the language of QCD jets with transformers
• OmniJet-$\alpha$: The first cross-task foundation model for particle physics
• Masked Particle Modeling on Sets: Towards Self-Supervised High Energy Physics Foundation Models
• What's Anomalous in LHC Jets?
• Lorentz group equivariant autoencoders
• A method to challenge symmetries in data with self-supervised learning
• Precision-Machine Learning for the Matrix Element Method
• A Method to Simultaneously Facilitate All Jet Physics Tasks
• Solving Key Challenges in Collider Physics with Foundation Models
• Anomalies, Representations, and Self-Supervision
• Re-Simulation-based Self-Supervised Learning for Pre-Training Foundation Models
• Discovering Sparse Representations of Lie Groups with Machine Learning
• Semi-visible jets, energy-based models, and self-supervision
• SKATR: A Self-Supervised Summary Transformer for SKA
• Unsupervised and lightly supervised learning in particle physics
• Learning the Simplicity of Scattering Amplitudes
• Triggering Dark Showers with Conditional Dual Auto-Encoders
• Top-philic Machine Learning
• Fine-tuning machine-learned particle-flow reconstruction for new detector geometries in future colliders
• MACK: Mismodeling Addressed with Contrastive Knowledge
• Contrastive Learning for Robust Representations of Neutrino Data
• Anomaly preserving contrastive neural embeddings for end-to-end model-independent searches at the LHC
• jBOT: Semantic Jet Representation Clustering Emerges from Self-Distillation
• Power Counting Energy Flow Polynomials
• Large Language Models -- the Future of Fundamental Physics?
• Vision Transformers for End-to-End Quark-Gluon Jet Classification from Calorimeter Images