Eigenvalues as a Metric for Memory Dynamics in Sequence Models

Rahel Rickenbach, Jelena Trisovic, Alexandre Didier +2

While softmax attention drives state-of-the-art performance in sequence modeling, its quadratic complexity motivates linear alternatives such as state space models (SSMs). Structur…