Learning to Recall with Transformers Beyond Orthogonal Embeddings

Nuri Mert Vural, Alberto Bietti, Mahdi Soltanolkotabi +1

Modern large language models (LLMs) excel at tasks that require storing and retrieving knowledge, such as factual recall and question answering. Transformers are central to this ca…