MARCH: Scaling Recurrent Memory with Content-Routed State Anchors

Ming Zhang, Kaisen Yang, Shu Yu +6

Transformers owe much of their strong long-context retrieval capability to a token-level memory that grows with context length. This flexibility, however, incurs a quadratic comput…