Memory Limitations of Prompt Tuning in Transformers

Maxime Meyer, Mario Michelessa, Caroline Chaux +1

Despite the empirical success of prompt tuning in adapting pretrained language models to new tasks, theoretical analyses of its capabilities remain limited. Existing theoretical wo…