Enabling Long FFT Convolutions on Memory-Constrained FPGAs via Chunking

Peter Wang, Neelesh Gupta, Viktor Prasanna

The need for long-context reasoning has led to alternative neural network architectures besides Transformers and self-attention, a popular model being Hyena, which employs causal 1…