Event-Driven Language Models with Sparse Neural Activity for Neuromorphic Hardware

Simon Richter, Ruhai Lin, Jason Yik +4

Inference with transformer-based large language models (LLMs) is often limited by the memory-bound KV cache and quadratic attention cost. State-space models (SSMs) mitigate this th…