Recognition, recall, and retention of few-shot memories in large language models

A. Emin Orhan

The training of modern large language models (LLMs) takes place in a regime where most training examples are seen only a few times by the model during the course of training. What…