3 papers
hep-ph2025
Why Is Attention Sparse In Particle Transformer?
Timothy Legge, Aaron Wang, Jacob Ortiz +7
Transformer-based models have achieved state-of-the-art performance in jet tagging at the CERN Large Hadron Collider (LHC), with the Particle Transformer (ParT) representing a lead…
hep-ph2024
Learning Symmetry-Independent Jet Representations via Jet-Based Joint Embedding Predictive Architecture
Subash Katel, Haoyang Li, Zihan Zhao +3
In high energy physics, self-supervised learning (SSL) methods have the potential to aid in the creation of machine learning models without the need for labeled datasets for a vari…
hep-ex2024
Large-Scale Pretraining and Finetuning for Efficient Jet Classification in Particle Physics
Zihan Zhao, Farouk Mokhtar, Raghav Kansal +2
This study introduces an innovative approach to analyzing unlabeled data in high-energy physics (HEP) through the application of self-supervised learning (SSL). Faced with the incr…