Towards Optimal Adapter Placement for Efficient Transfer Learning

Aleksandra I. Nowak, Otniel-Bogdan Mercea, Anurag Arnab +3

Parameter-efficient transfer learning (PETL) aims to adapt pre-trained models to new downstream tasks while minimizing the number of fine-tuned parameters. Adapters, a popular appr…