LM2: Large Memory Models

Jikun Kang, Wenqi Wu, Filippos Christianos +5

This paper introduces the Large Memory Model (LM2), a decoder-only Transformer architecture enhanced with an auxiliary memory module that aims to address the limitations of standar…