6 citations · 12 across the 8 of their papers we have counts for
4 papers · 1 filter
Conditional Capacity and Routing in Mixture-of-Experts Particle Transformers
Kaushik Pendiyala, Haris Zia, Trevin Lee +8
Mixture-of-Experts (MoE) models can increase parameter capacity without proportionally increasing active computation, but it is unclear how this trade-off behaves in particle-physi…
SNAC-Pack 2.0: Scaled-Out Surrogate Neural Architecture Codesign
Jason Weitz, Dmitri Demler, Benjamin Hawks +3
Neural architecture search (NAS) is a powerful approach for automating model design, but existing methods often optimize for accuracy alone or rely on proxy metrics such as bit ope…
Spatially Aware Linear Transformer (SAL-T) for Particle Jet Tagging
Aaron Wang, Zihan Zhao, Subash Katel +6
Transformers are very effective in capturing both global and local correlations within high-energy particle collisions, but they present deployment challenges in high-data-throughp…
Ultra-low latency recurrent neural network inference on FPGAs for physics applications with hls4ml
Elham E Khoda, Dylan Rankin, Rafael Teixeira de Lima +10
Recurrent neural networks have been shown to be effective architectures for many tasks in high energy physics, and thus have been widely adopted. Their use in low-latency environme…