SuPER-Mamba: Surprisal Prioritization for Extended-Context Routing in Mamba

Zhetong Zhang, Gayan K Kulatilleke

State space models provide efficient linear-complexity processing for long sequences, but their performance frequently degrades as context length grows. We propose SuPER-Mamba, a t…