Global Divergence, Local Convergence: Representation Geometry in SSMs and Transformers

Amit Ben-Artzy, Roy Schwartz

Recent state-space models (SSMs) such as Mamba achieve language modeling performance comparable to transformers despite relying on fundamentally different architectures. This raise…