Write What Matters: Disentangling Token Selection from Slot Allocation in Recurrent Memory

Chen Chen, Rui Cheng

Long-sequence models must retain earlier information. Full attention keeps all past tokens but grows expensive, and recurrent-memory models compress history into fixed slots for li…