Ultra Fast Transformers on FPGAs for Particle Physics Experiments

Zhixing Jiang, Dennis Yin, Elham E Khoda +6

This work introduces a highly efficient implementation of the transformer architecture on a Field-Programmable Gate Array (FPGA) by using the \texttt{hls4ml} tool. Given the demons…