Fast Forward: Accelerating LLM Prefill with Predictive FFN Sparsity

Aayush Gautam, Mukul Gagrani, Junyoung Park +3

The prefill stage of large language model (LLM) inference is a key computational bottleneck for long-context workloads. At short-to-moderate context lengths (1K--16K tokens), Feed-…