Rethinking Selectivity in State Space Models: A Minimal Predictive Sufficiency Approach

Yiyi Wang, Jian'an Zhang, Hongyi Duan +2

State Space Models (SSMs), particularly recent selective variants like Mamba, have emerged as a leading architecture for sequence modeling, challenging the dominance of Transformer…