Meta-Learning Transformers to Improve In-Context Generalization

Lorenzo Braccaioli, Anna Vettoruzzo, Prabhant Singh +3

In-context learning enables transformer models to generalize to new tasks based solely on input prompts, without any need for weight updates. However, existing training paradigms t…