Why Is Attention Sparse In Particle Transformer?

Timothy Legge, Aaron Wang, Jacob Ortiz +7

Transformer-based models have achieved state-of-the-art performance in jet tagging at the CERN Large Hadron Collider (LHC), with the Particle Transformer (ParT) representing a lead…