Parity Requires Unified Input Dependence and Negative Eigenvalues in SSMs

Behnoush Khavari, Mehran Shakerinava, Jayesh Khullar +4

Recent work has shown that LRNN models such as S4D, Mamba, and DeltaNet lack state-tracking capability due to either time-invariant transition matrices or restricted eigenvalue ran…