LEAF: LUT-aware Efficient Attention on FPGAs

Arianna Cox, Chang Sun, Lauri Laatu +7

We introduce Lookup-table (LUT)-aware Efficient Attention on FPGAs (LEAF). LEAF is the first nanosecond-scale LUT-aware transformer for FPGAs. Deploying transformers that are large…