Can Memory-Augmented Language Models Generalize on Reasoning-in-a-Haystack Tasks?

Payel Das, Ching-Yun Ko, Sihui Dai +3

Large language models often expose their brittleness in reasoning tasks, especially while executing long chains of reasoning over context. We propose MemReasoner, a new and simple…