Enhancing Length Extrapolation in Sequential Models with Pointer-Augmented Neural Memory

Hung Le, Dung Nguyen, Kien Do +2

We propose Pointer-Augmented Neural Memory (PANM) to help neural networks understand and apply symbol processing to new, longer sequences of data. PANM integrates an external neura…