5 papers
SNAC-Pack 2.0: Scaled-Out Surrogate Neural Architecture Codesign
Jason Weitz, Dmitri Demler, Benjamin Hawks +3
Neural architecture search (NAS) is a powerful approach for automating model design, but existing methods often optimize for accuracy alone or rely on proxy metrics such as bit ope…
Patch Hierarchical Attention Transformer for Efficient Particle Jet Tagging
Aaron Wang, Zihan Zhao, Alan Xia +5
Real-time jet tagging is critical for identifying short-lived particle decays in the high-throughput detectors of the Large Hadron Collider, where real-time trigger systems respons…
Spatially Aware Linear Transformer (SAL-T) for Particle Jet Tagging
Aaron Wang, Zihan Zhao, Subash Katel +6
Transformers are very effective in capturing both global and local correlations within high-energy particle collisions, but they present deployment challenges in high-data-throughp…
Why Is Attention Sparse In Particle Transformer?
Timothy Legge, Aaron Wang, Jacob Ortiz +7
Transformer-based models have achieved state-of-the-art performance in jet tagging at the CERN Large Hadron Collider (LHC), with the Particle Transformer (ParT) representing a lead…
Interpreting Transformers for Jet Tagging
Aaron Wang, Abhijith Gandrakota, Jennifer Ngadiuba +4
Machine learning (ML) algorithms, particularly attention-based transformer models, have become indispensable for analyzing the vast data generated by particle physics experiments l…