1 citations · 1 across the 5 of their papers we have counts for
7 papers
RINO: Renormalization Group Distillation with No Labels
Zichun Hao, Raghav Kansal, Abhijith Gandrakota +6
Supervised machine learning in high-energy physics (HEP) requires training on labeled simulations of particle collisions, which are known to be unfaithful to the underlying physics…
Conditional Capacity and Routing in Mixture-of-Experts Particle Transformers
Kaushik Pendiyala, Haris Zia, Trevin Lee +8
Mixture-of-Experts (MoE) models can increase parameter capacity without proportionally increasing active computation, but it is unclear how this trade-off behaves in particle-physi…
hls4ml: A Flexible, Open-Source Platform for Deep Learning Acceleration on Reconfigurable Hardware
Jan-Frederik Schulte, Benjamin Ramhorst, Chang Sun +50
We present hls4ml, a free and open-source platform that translates machine learning (ML) models from modern deep learning frameworks into high-level synthesis (HLS) code that can b…
Why Is Attention Sparse In Particle Transformer?
Timothy Legge, Aaron Wang, Jacob Ortiz +7
Transformer-based models have achieved state-of-the-art performance in jet tagging at the CERN Large Hadron Collider (LHC), with the Particle Transformer (ParT) representing a lead…
Spatially Aware Linear Transformer (SAL-T) for Particle Jet Tagging
Aaron Wang, Zihan Zhao, Subash Katel +6
Transformers are very effective in capturing both global and local correlations within high-energy particle collisions, but they present deployment challenges in high-data-throughp…
RINO: Renormalization Group Invariance with No Labels
Zichun Hao, Raghav Kansal, Abhijith Gandrakota +4
A common challenge with supervised machine learning (ML) in high energy physics (HEP) is the reliance on simulations for labeled data, which can often mismodel the underlying colli…
Interpreting Transformers for Jet Tagging
Aaron Wang, Abhijith Gandrakota, Jennifer Ngadiuba +4
Machine learning (ML) algorithms, particularly attention-based transformer models, have become indispensable for analyzing the vast data generated by particle physics experiments l…