PETapter: Leveraging PET-style classification heads for modular few-shot parameter-efficient fine-tuning

Jonas Rieger, Mattes Ruckdeschel, Gregor Wiedemann

Few-shot learning and parameter-efficient fine-tuning (PEFT) are crucial to overcome the challenges of data scarcity and ever growing language model sizes. This applies in particul…