Lost in State Space: Probing Frozen Mamba Representations

Bhagyashree Wagh, Akash Singh

Mamba's recurrent state h_t is, by construction, a compressed summary of every token seen so far. This raises a tempting hypothesis: if we extract token-level outputs y_t at fixed…