CyFA: Linear Sequence Modeling with Relative-Time-Partitioned Memory

Yixiao Chen, Shuojin Yang, Shi-Min Hu

Linear RNNs offer linear-time sequence processing and constant-memory decoding, but their fixed-size recurrent states must accommodate all past key--value associations. Existing fo…