MeMo: Towards Language Models with Associative Memory Mechanisms

Fabio Massimo Zanzotto, Elena Sofia Ruzzetti, Giancarlo A. Xompero +6

Memorization is a fundamental ability of Transformer-based Large Language Models, achieved through learning. In this paper, we propose a paradigm shift by designing an architecture…