Learning infinite context windows in recurrent architectures via spatial neural computing

Aleix Salvador-Pomarol, Arthur N. Montanari, Earl K. Miller +2

Recurrent neural networks (RNNs) offer linear-time scaling with sequence length while requiring only constant memory, yet they struggle to capture long-range dependencies due to va…