LISM: Long-range Integrative State space Models via Input-Latent State Interactions

Cong Ma, Kayvan Najarian, Hovhannes Baghdasaryan +1

State space models (SSMs) are an emerging paradigm that achieves linear-time scaling, however, they intrinsically suffer from "curse of memory". The memory of SSMs, including Mamba…