Non-Commutative State Tracking with Input-Dependent Low-Rank Updates in Mamba-3

Hiroki Fujii, Masaki Yamakita

State tracking from sequential observations can require both retaining information and updating it by composing observed operations. We extend Mamba-3's diagonal transition with an…