How Many Heads Make an SSM? A Unified Framework for Attention and State Space Models

Ali Ghodsi

Sequence modeling has produced diverse architectures -- from classical recurrent neural networks to modern Transformers and state space models (SSMs) -- yet a unified theoretical u…