Gather-Scatter Mamba: Accelerating Propagation with Efficient State Space Model

Hyun-kyu Ko, Youbin Kim, Jihyeon Park +5

State Space Models (SSMs)-most notably RNNs-have historically played a central role in sequential modeling. Although attention mechanisms such as Transformers have since dominated…