Memory Mosaics at scale

Jianyu Zhang, Léon Bottou

Memory Mosaics [Zhang et al., 2025], networks of associative memories, have demonstrated appealing compositional and in-context learning capabilities on medium-scale networks (GPT-…